Have a look at the VR support in the Unreal Engine editor[0]. You can actually manipulate the virtual world while inhabiting it! It's not much of a stretch to apply the same principles to CAD.

[0] https://docs.unrealengine.com/latest/INT/Engine/Editor/VR/