c'mon, I also live in the Bay and I think reality is somewhere in the middle between the original doom and gloom message and your rose colored glasses view. We have HUGE homelessness and untreated mental illness issues around here, and most urban centers are absolutely filthy cause of those.
This is a place that has big issues, no matter how much you manage to ignore them on your way to the nice restaurant for dinner with your friends.