I think your perspective might change once you have kids (forgive me for assuming you don't yet).

That additional hour or two a day that you can spend with your family might end up being worth more to you than the prospects of social life and building a carreer with other like-minded people.

I really agree with the sibling comment about people having different perspectives and priorities. Perhaps you could find what you're missing somewhere else instead of trying to convince your colleagues to come back to the office?