You’re missing the forest for the trees.
It's perfectly reasonable to be priced out of some areas of the world, there is nothing at all wrong with that as a general concept.
The issue is that we’re seriously restricting growth and innovation in favor of using housing as a financial investment. Yes, it’s necessary to have some degree of inequality and nobody is entitled to to live in any exact spot, but it’s gotten out of hand at this point, it’s hurting our societies, and it’s unsustainable.