I'm in that boat actually. It really just comes down to the people, like always. The teammates that meet together show respect for the remote folk, so it works. But I've definitely been at places that didn't really have that sensitivity for others, and it sucked.
My previous gig has an onshore offshore team that I interfaced with. Then they would interface with the offshore team. And the offshore team had its own very offshore team (not sure which shores we're on). I felt lucky that most of the onshore offshore team didn't like me much which meant all I needed to do was create the features that they tried and failed to do. It was a symbiotic pile.