You're thinking too narrowly. Your point is correct, but the broader point is that there should be those same work opportunities spread out around the country so that you don't have to move to SF or wherever to get a good job. That is what hurts the economy on a broader scale.

Employment is "sticky" in that personal mobility can't move as fast as capital mobility and that seems to have led to concentrations of wealth.