I'm not from the US :) By "self-build", you mean you actually build it yourself? Doesn't the bank require professionals who can present invoices and such?
I'm short on free time anyway so it's not that big of a deal but finding a lender that would let you do everything is probably a bit tricky.