I imagine the dealbreaker for most young couples expecting kids is the cost of renting a 3+ bedroom in SF more than any fear of raising kids in the city.
Well, there is the dreaded PS lottery[1]. So unless you both are working and can put the kids in private school, the kids may well end up in one of the district's poorly run schools.