"Leave your friends and family, abandon the area that you grew up in for 30 years" is not really practical advice. Maybe it works for you, but it does not for other people.

You are right about this though: it is supply and demand. And currently there is a lot of regulatory capture on the supply side. Meanwhile there are new investment vehicles on the demand side.

I don't know what the solution is, but when I watch my local news, not a week goes by that I don't see a headline about a developer trying to build some high density housing, but local residents show up to some board meeting and complain about it until they reduce the density. The reasons given make no sense. "It's not part of our community plan"... So change the plan??