Any favorite ideas or literature pointers?
I've an interest in coding in VR/AR. But even pushing current HMDs with custom stacks, it's not, for me, yet competitive with screens. Since the hardware market is being so dysfunctionally slow to do the easy, I'm stuck to doing hybrids. Blending of screen 2D, anaglyph, and HMD. Laptop with kludged optical hand and chopstick tracking. Annoying eyewear swapping.
Point is, I've been surprised by how unhelpfully limited the 3D UX literature I've seen has been. It's almost like no one has pursued it with serious intent. That "almost a joke" resonated. Perhaps by the time someone struggles with interface devices, and a bit of code, well, you have your paper or thesis, and there's no big market, so you're done.
But with improving web dev and python ecosystems, it's now more plausible than ever to do full-stack reinvention, devices to environment to apps. No market, but something for itch scratching and joy. Still daunting, but seemingly small-team/silly-person accessible. But I'm missing that warm fuzzy feeling of knowing just how I'm positioned wrt an organized professional research effort. And the collaboration.
Perhaps it is because we're interacting with 3D objects in real space all the time. Unfortunately we're still lacking a convenient and widely available device to interact with virtual objects. VR/AR helmets are not convenient. <sarcasm>Imagine the success of 2D desktops if we had to wear sensor gloves instead of using mice and touchpads</sarcasm>. Even them were not optimal. Touching a screen with a finger was so better (for low precision pointing) that for some people it's the only interaction device with a computing device.
[citation needed]
To be fair this doesn't necessarily mean AR/VR is the future. It could mean a physical designed for computing like Dynamicland or a single device that has intelligent real-time understanding of the physical world that isn't and hmd or a phone.