Also things like you have a meeting and someone is late - when everyone is remote, it is very easy to expect and accommodate it. But when most or many are in office and in a room and one person that is remote is late - probably won't be as well received.