Same here. Seeing their lips move often provides just enough additional information for me to correctly guess their words.
Nowadays, with high definition and close to no perceivable latency. Early video chat was so bad that having the video on was more distracting than helpful.
I can see this not being the case with international latency causing lag between audio and video