The Silicon Valley area is surrounded by either hills or ocean, so "a little farther" is a difficult commute with varying delays of hours on a couple roads.
Nobody wants to raise a family in Oakland.
Also, my understanding is that the Central Valley is a flood plain.