VR still a novelty, but Google light-field technology could make it serious art
technologyreview.com
technologyreview.com
This approach is a pretty major step for creating believable VR experiences. You're still limited to a pretty small space (great for seated users), but the effect is very convincing and entirely unlike traditional photo-captured experiences previously available for VR. You can move your head around (but only within the sphere) and everything tracks the way you'd expect: parallax works, light rays through windows move, reflections change as your perspective changes, and people's eyes can track you as you move.
If you consider how Google Cardboard works, it exploits the fact that the camera has a field of view - the image is perspective. So when you hold the camera at 10 degrees left from center, it takes the right-most column of pixels... And when you hold the camera at 10 degrees right of center, it takes the left-most column of pixels. And these columns of pixels converge - as though your head were as wide as the distance between those two points where the camera was. (Something like that.)
Point being, if you move the camera through enough points, aimed in enough directions (even if it's on the surface of a sphere, always aimed out), you eventually capture rays of light as though they passed through every voxel in that space, from every direction.
And, just to highlight, they are doing a TON of compression. This is essentially inside-out tomography, or something like that, to derive what the color is, from every voxel, in every direction... And then doing a 5-dimensional compression on that data (2D surface of a sphere of pixels, at every position inside a 3d sphere.)
So, I think it's a much more "decent approximation" than you're giving it credit for.
Or at least, it has the potential to be, if the algorithms are good enough.
Edit: the OTOY capture video: https://www.youtube.com/watch?v=pyJUg-ja0cg
OTOY does a light field renderer, which is essentially a bunch of computer animations, glued together to make a light field.
But they're also doing (like this article) a light field capture.
It's entirely possible the OTOY light field renderer is awesome... but that the light field capture is no good.
I don't think that's the case, but I just wanted to point out those might be two different things.