For California specifically, there are three factors:
1. Originally, the area was home to several very good universities. Today, these provide a ready source of workers with advanced job training. On the other hand, I'll bet they are a small minority of the workers in the area now.
2. That's where the money is. Much of the "capital"[1] comes from previously successful businesses and those people don't want to move (and don't have any problems with high rents).
3. Density promotes density. More workers there makes hiring new ones easier (and replacing old ones), and the availability of "attractive" jobs draws more workers.
The area hasn't (and probably can't) adapt as fast as money and immigrants, hence the infrastructure issues.
It's hard to fix that from the top down. Take Austin, which did it from the bottom up; a number of foresighted rich folks boosted UT's tech training, leading to it's success in recent decades, but it's now facing the same problems.
Options:
Hold your nose, go to CA and make your money and get the hell out.
Wait for the next cyclic bust, buy property when the prices collapse.
Organically start the process elsewhere, with the same results.
Choose to go elsewhere and accept the salary reduction.