Yea, I feel similarly.
I'm actually really excited for Lenovo's upcoming T1 wearable display. It's a monitor in glasses form, not VR, but I realized that the appeal of VR desktop environments for me is having a large screen, not the whole VR shtick.
Couple that display with output from my phone running JupyterLab, and I'll have a desktop-like development environment that fits in my pocket. Perfect for travel and long backpacking trips.