Also, in a perfect world this will all just be a transition step before we get full on holodecks.
We're doing our own small part to try and make that happen with our automated 3D scanning platform (http://realityzero.one)
If it’s a cartoonish game, the imaging doesn’t need to be photo-realistic. If it’s ‘toon style or lit and textured by photography of real environments, the polygon count doesn’t need to be high.
What it does need, beyond the hardware, is immersive physics, and a gameplay-justified reason for why you can’t run through the furniture/wall/cable that you can no longer see. The game “I Expect You to Die” does that perfectly because you’re sitting down the whole time.