You're inevitably forcing your colleagues into your own way of working to some extent. Imagine a team of 6 people working on the same product:
If 1 is in office and 5 are remote, then the benefits of the office are largely lost even for the 1 person. That 1 person is still working in a remote model just from a different location which happens to be the office.
If 1 is remote and 5 are in office, the 1 person will inevitably miss out on a lot of the ongoing in-person communication. This was a well-known thing before the pandemic - the most common advice was to be remote for entirely remote companies/teams but to avoid being the only remote person on an office-based team.
If it's 3-3, then some of the communication is in person and half of the team is missing out on it but all meetings still have to be online.
I don't doubt that some companies will do this but it doesn't seem stable in the long run.
In fact I started working remote full time because after our company moved us to a fancy new open-office floorplan in the city my commute went from 20 mins to 75 and I realized I was wasting all that time just to be on virtual meetings in the office, so I stopped going in. Even when we were all in the office, meetings tended to be online anyway because the company did not build nearly enough conference rooms.
Having an online-first culture even before COVID never seemed to be a big problem for us. Obviously YMMV.
Don't fear the idea just because in your mind there are purely hypothetical situations where it might not be optimal.
The direct opposite of your opinion & posited hypothetical situation may exist in someone else's mind.
This was already the case even for 100% on-site. It was just woven into the culture, so it didn't seem anomalous.
Before the pandemic, people still had to accommodate people with different working habits. This is where we got ideas such as hierarchies and "silos." There were unwritten rules about who was more important than who, whether they could have an office with a door, who could be interrupted and who couldn't. There were multiple channels of information that were not accessible to all.
I noticed that during the pandemic, there was as much or more communication among the rank and file, because it was easier to get lost without staying in touch. I had to be more careful about getting good information before proceeding on faulty assumptions. My group also became more global.
Oddly enough I'm back in office now, but in an isolated lab where I'm alone 90% of the time. And my team's boss is in another state.
In fact, the refusal to acknowledge the truth that alternatives exist (albeit out of the box alternatives) strikes me as a common way for in-office advocates to shut down the WFH conversation.