Where did you live? People always talk about shit on the streets, but I only really see it as an issue in like downtown(SOMA,Tenderloin,etc) and tourist areas. I've lived in the residential areas (usually within a block of a major street with shops and restaurants) for 6+ years and it has never been an issue.

And the areas I've lived in definitely have massively more "SF culture" than downtown.