I got your point. Yes, telephone calls would eliminate distractions but it lacks a lot of necessary features. Sharing screen is a must in our company. Also no whiteboard alternative. And we have many non-native English speakers so voice only might not be enough to always understand what they're saying.
I think a telephone call might be good for a few cases but in our case (technology/marketing company,) I don't think it's a good way to communicate remotely.