One problem seems to be that either everyone on your call has VR headsets, or you can't use VR at all. A huge outlay in hardware, or nothing. Is there a way for people to join a VR meeting without hardware and still have a decent experience?
Yeah. In workrooms non-VR people can still join in. They appear as a video feed in the environment, and they see a rendering of the meeting from that perspective. It's still quite rich for everyone, eg you can tell when VR people are listening to you because they instinctively all turn their heads to look at your video.
It's not that much different of a problem compared to real life hybrid calls between conference rooms and other conference rooms / remote workers.