When I worked in a building, I would go to meetings, and there I would see co-workers and people would talk to each other in meetings. When I work remotely, I join virtual meetings, and I see co-workers and people talk to each other.
In both cases, people can use chat to say things without me seeing. If I am physically in a building, but people are not in the same room as me, they can talk to each other without me hearing.
The only premise that could be true is that within one organization, people that cannot be remote may resent people that can.