The people who grew up there (whose parents owned homes) are doing quite well (at least their parents are) because of the vast appreciation of their homes. Among some of my wealthy friends that have paid ridiculous prices for real estate in SF, I have heard the rather condescending term "thousand dollar millionaires" used to refer to these long-term homeowners that did nothing to create a $1M+ net worth other than pay their mortgage and live in the same place for decades.
Anyway, it's not the people who grew up there that you should feel bad for. It's the people that need to be there for one reason or another and can't afford a living wage with the incredibly inflated prices and taxes associated with living in SF and California in general.