In the most material terms, they're probably more distracted than two people who are both present and chatting which isn't great for anybody's experience. People also tend to be shouting into the phone, worse if they're not using headphones so you get to hear the other person shouting back.

At a psychic level it also kind of sucks in ways that are harder to describe.