This was a critical factor that led to me relocating from SF to NYC. While it's nice having every tech giant and startup in close proximity, the homogenous conversations and social interactions were a huge drawback.
There's definitely a trade-off -- while it's nice being exposed to the issues people experience in a variety of industries, it was nice having easy access to engineers/friends willing to hack on ideas in SF.