The problem you describe does not get enough attention. The state and local governments have seriously mismanaged growth over the last half a century or so. The individual person's quality of life has truly been diminished in the way you describe.
I grew up (and my parents live) near San Luis Obispo, CA. The central coast has: pockets of perfect weather, proximity to wonderful beaches, proximity to winte rsports, etc. Yet, there's under a quarter of a million people in their gigantic county, and a small apartment or house can be found for a (fairly) reasonable price in parts of the area. SLO even has a fantastic university and a bit of tech has sprung up around it (Amazon has SWE offices, etc).
Much like people who don't live on the coast harp on, there's much more to CA than the popular few cities.