I agree with your point and that's probably not the primary audience for VR.

A more likely audience is the millions of people who, for example, played Call of Duty together last night. Most of those players were connected remotely via a virtual world and voice chat and did not share a geographic location much less the same room.