I wonder how much of a speedup you could get by doing eye tracking and only rendering high quality for the area within the fovea.
Participants perceived jumps in shadow quality much harsher than lower resolution shadows.
It saved a lot of memory though, that was nice.
Microsoft has a great paper on more general foveated rendering.