The argument is that not enough housing to meet demand is because of the policies and politicians of SF. There are levers with which they can control both the demand and supply.
Let some of the money go elsewhere and boost some other city's economy rather than having it all focused in one place to the point of it causing major problems.