I've been remote on a non-remote team, and I definitely felt all the cons of remote much more than on a full remote team, because well, that's when you actually end up isolated. Everybody is having face to face communication, building stronger relationship, meanwhile you kind of get forgotten because you are not present.
If everyone is remote, then everyone is in the same situation and there is a better balance.