This idea goes back further than you might think. The "Stereoscopic Workspace", from the Architecture Machine group at MIT in 1983, was a prototype of this idea, surprisingly close to this implementation 30 years later.
http://media.mit.edu/speech/videos/?video=Stereoscopic%20Wor...
http://media.mit.edu/speech/papers/1983/schmandt_SIGGRAPH83_...