My biggest business gripe is the lower fidelity and higher friction with collaboration (planned and not) with my team and other departments / businesses. There's a loss of energy, creativity, focus, ease, alignment, etc. that just isn't there for me with email, video/phone, chat, etc. My biggest personal gripe is related. I'm more extraverted and the loss of regular social interactions is tough. I miss going out for lunches, breaks, drinks, walks, etc. with people that I think are interesting without having to do much to set it up.
I come in to the corporate office once a month for about a week. It feels like we get more done, have a good amount of fun, and clear things up faster. Even remote, we're still doing much better than the team before us which was full onsite. I guess that's why they keep me around. But I miss the tighter vibe and will probably soon start looking for something near me.
I've always felt that some hybrid approach would work well. Some days, everybody's in (group stuff); some days, everybody's working from home (crank).