The biggest stepping stone is interfacing into a virtual 3D world. Unless you can make the "controls" as seamless as possible, it's not going to catch on. This involves finding ways to access information quickly and making the experience intuitive and not clunky.