It's actually insane, it's been over a decade, and nobody put 2+2 together on this. It's right in the name... Head Mounted Display.
I bet Luckey had something like this working in the early days but abandoned it because it wouldn't work for games. What a shame