I feel hopeless that this will ever change. In a extremely liberal city like San Francisco, where nearly every citizen follows progressive politics, NIMBYs have passed laws the enrich wealthy renters and make it hard for the poor to afford to live in the city.
If San Francisco cannot get this right, no one can.