Does anyone work in a remote team with an always-on video conference?

I really, really prefer being able to shout out a quick question but the friction costs (and fear of interrupting deep thought) about calling someone, sometimes even a Slack message, prevents communication at times.

The times where I've been pairing or on a long call "in the background" have been great I thought. Any downsides for those who do this regularly?