Our society can't operate without an integrated workforce and you can't have an integrated workforce if you segregate people based on their income.
For every software engineer in the Bay Area there is an army of waiters, cooks, janitors, sanitation workers, retail workers, office workers, school teachers, nurses, and unskilled laborers that supports him. And if you move them all out, well, I don't think that I have to explain the consequences of that action.