Where I see it really shining is as a successor to staged plays, and cinema.
The thought of allowing viewers to really deeply immerse, comfortably for long periods of time, to control the point of focus, to move around.
Kurosawa would shoot movies by building whole sets with all walls intact that worked from every angle, and having the actors perform the scene over and over like a contiguous play, and then this would eventually be shot from 3 fixed points in a single take, offering a consistent and seamless edited final version with perfect continuity... imagine this with an array of lightfield cameras capturing the set and actors, and using CGI to gap fill angles where necessary... and then allowing people to experience cinema from within the set.
Or, imagine animated cinema where the animations are real-time inserted into a set that you move around and interact with. The magical real being tangibly real.
Beyond games, beyond the AR/VR as we've experienced, I think that there's a really rich content vein that could be tapped within pure entertainment consumption, and that of the technologies lightfield tech may give the best control and experience to consumers.