On the other hand, the market isn't everything, especially in the near-term. The market, for instance, won't create diversity in the city; it will create a monoculture of whatever is working that decade. So, right now, in SF, it will create a monoculture of tech workers as, in Manhattan, it almost created a monoculture of finance workers in the '80s/'90s. Monocultures lack resilience and if NYC hadn't traded its finance economy for a tourist-driven one, it could have been hard times. Booms and busts may be okay from a Liberal philosophy point of view, but it's hell on the people caught in it.
The other thing about diversity is it's part of the reason people move somewhere in the first place. One of the reasons tech has moved from the Valley up into SF is that SF has more diversity, so it's not all tech all the time. It would make sense to try to preserve what it was you wanted in the first place (even if, a la any gentrifying neighborhood, it may be a bit of a lost cause.)
Is NIMBY-ism "government regulation"?
In this context it's worth looking at Aspen, CO. Wages for service workers there have not gone up, and 60-mile commutes on mountain roads are common. I have no theory for why that is, but I do not expect a different outcome for SF.
Not sure what science has to do with this anyway; this is basically a matter of public-policy/politics/economics.
That's what I'm worried about. Populations shift, people move, cities grow. But, if you're running a city, you want growth to be stable and predictable. If you drive out all of your lower-income workers to other cities and "import" your labor, you are setting yourself up for an unstable labor market in the future.
These things need to be planned for, and it doesn't seem like there is a lot of thought being put into it.