Put differently, "affordable housing" and "housing as investment" are at odds. People don't acknowledge this tension enough, I suspect because many people want to switch to the housing-as-investment team.
Imagine if we restricted how many cars could be made a year, with the predictable result of new and used car prices steadily increasing every year. And then when anyone suggested what maybe we should let car makers make more cars, you got a bunch of people complaining about the property values of the cars they already owned, or that this would ruin car culture.
It’s at least partially rational, though: usually non-car transportation is hilariously impractical wherever they currently live, and also wherever they’ve lived in the past.
The struggle is to get people to see what could be possible when they have minimal to no experience with it.