I would say that when you reach the point of being able to accurately represent final CG in realtime, a huge number of possibilities open up :)
(My current bee-in-bonnet, besides integrating HMDs and mocap, is realtime-ish path tracing - but that's a while away yet, still.)