I think it's more about cultivating culture. It's almost impossible to build culture with 80% of your staff working remotely on different timezones. There are ways around it but it's just way better to see your team.
All of my remote gigs have had very different cultures. People communicated, friends were made, etc, etc.