In the limit, that's like buying the house with cash up front, which amounts to betting that the appreciation will exceed any investment income. For example, given person A who paid cash for a house a year ago and person B who put that money into an index fund, in most parts of the country B would be much better off right now.