I would get with my legal council on this one. It's a weird setup. Personally, if I owned the lot, I would not want anything to jeapordize that in which I may not have control over. How can the builder be on the loan without being a guarantor, or really, a co-borrower?
Legal. Council.
Perhaps there can be some sort of legal side agreement authorizing the builder regarding draws...Having said that, I as the borrower and the one obligated, would want dual control over that as well.
_________________________
My opinion only. Not legal advice.
Say you'll haunt me - Stone Sour