If you're not buying lattes to compete for the same pool of available houses (and other people are doing that), you are absolutely ruin your economy by starving it for cash, while having price growth destroy any of your latte savings.

Buy lattes and consider moving to where housing supply is not constrained.