Outside of space-limited desirable locations where house prices are the result of a bidding war, the problem of house prices is related to expectations and the resulting regulation.
To get an FHA loan, all sorts of stuff has to be present and in good condition. Zoning requirements, building codes, and the ADA have all jacked up prices. You can't just build yourself a shack anymore.
Example location: Sommerville Massachusetts, where you can't legally build the city today. Nearly everything is in violation. The same applies in Manhattan.
Example feature: We now have to have arc fault interrupters and wired-together fire alarms, even if you can't stand them. For decades we got by with low-cost circuit breakers and battery-powered fire alarms.
People who are living well start to see expensive things as being important, and so they feel that the features should be mandated, and it seems like only a trivial cost... but just like software bloat, it adds up over time. Sellers of the features push for it too. We end up pricing less-well-off people out of the market.
I am simply prohibited from building a house that would have been good-quality construction in medieval times. I can't even build an ordinary house of the 1980s... and even last year's design is often illegal to build. There is a ratchet effect here. Requirements keep getting added, but none are ever removed.