The Sunset or Richmond or any other 'far' neighborhood is not Manhattan-like.
Maybe the light colors in San Francisco's outlying neighborhood's architecture make them look just even more distant and quiet / abandoned?
Also, the ease of getting into the heart of manhattan (say Union Square for both cities) from north Manhattan just feels different than taking the Muni/Bus in SF. You're inside the subway, enclosed and underground. The neighborhoods that have that distant feeling in NYC are ones like Flushing, Gravesend & Jamaica. Or Canarsie. Canarsie is so far away...
Also, Hi Tom - This is Alex from the first Stuy meetup :)