I'm really not a fan of the external camera. IMHO the ultimate solution is for a camera (or two) on the headset running SLAM to create a virtual world that overlays the real world. Then the experience has to be designed to map onto a large variety of real world environments. You're still free to change the textures and lighting of course. While this is not a generally applicable concept, it would make the virtual experience vary depending on your real-world location. Imagine going to a friends house to play Doom because his house is actually more fun.