(This is the general you, not the specific you, of course.)
But no, let's take a loan out against our RSU's so we can get a $1M bi-level because the schools in this district are amazing /s. Now a house in North Carolina is worth as much as one in New Jersey.
> $1M home at 3% interest(30year) = ~$4200 monthly payment. $800k home at 6% interest = $4800 monthly payment.
Over a 30 year term, your interest rate has much more impact on affordability than the purchase price does. 20% down is a drop in the bucket when your rate necessitates paying 1.5-2x the purchase price in interest because it's spread out over 30 years, especially at higher price points and at the edges of people's budgets.
If the house prices is lower, every extra payment to the principal will drastically decrease the interest over the entire term, much more-so than the initial larger loan/principal.