Yes. It's really the combination of climate (usually) and relatively easy access to water, mountains, etc. that set San Francisco apart. IMO, anyone who lives in SF and basically never leaves the city except maybe to work is passing up the main compensation for its high housing prices and many problems. Take away its setting and it's pretty unremarkable.

[ADDED: OK. Not really fair but what make SF unique is very tied into its geography.]