And I'll add my own anecdote: the top performers on the 100+ software engineer org I work in are either fully remote or mostly remote. Losing our fully remote people would be catastrophic to the team. Collaboration with them is extremely easy, even from different time zones.
On the days I go to my office, all I observe is people wearing headphones to be able to focus. Team lunches are nice, but we never talk about work. As I've already developed personal connections with my coworkers, I could go months without seeing them in person (as a matter of fact, that's what happens with my coworkers who live across the country).
The famous "whiteboarding sessions where ideas are born" can be easily done remotely, or in one off events in the office if people who believe in office work insist. I found shared docs and basic digital whiteboards allowing me to draw rectangles, arrows and labels as efficient than physical chalk/marker boards. Why? Because the hard work is on the ideas and conversations, not the drawing.
Also anecdotally, in 10+ years of office work, I've never observed a single "watercooler conversation" leading to a particularly interesting idea. I generally hear sports, weather chat and complaints about the food by the watercooler. Oh, have you seen that? I'll counter that with the dozens of non-watercooler conversations that led to interesting ideas.