Pano content in VR really is something new.
Apple's lack of vision with the Vision Pro is shocking as is the arrogance that somehow a $3k headset will revive interest in something people wouldn`t pay an extra $5 for at the movies.
With twice the memory and a desktop grade processor the AVP could trash the Quest 3 at immersive application but Apple is stuck on a backwards and conservative vision of mobile apps floating in the air - totally mundane sci-fi (Washuu had this in Tenchi Muyo) but a $3k headset has to do all, not just what one rich dude thinks is stylish.
If you are doing any VR or AR work you realize memory for textures is terribly short and 'more pixels' is the road to nowhere.
Lots of as-well-made-as-able 3D "stereo" movies in Disney etc that work on AVP beautifully. None of those are the same "you are here now" sense as the Alicia Keys demo.
Agree with you on Apple's seeming reluctance to empower a new UX/UI for the AVP affordances. Having a multi-window iPad strapped to your face is less compelling. Over the past 15 years one notices how much of iOS UI was invented by the market (pull down to refresh, for instance). Perhaps they want to see what people come up with for this.
Not going to happen without jailbreaking the locked-down VisionOS.
Apple could choose to enable for 18 months, then integrate the best use cases into the platform.
Yes, you'd have to have your various "apps" in your same "suite" app (like Microsoft ships Word, Excel, Powerpoint, inside Office for iPadOS), but third party apps wouldn't know your new UX/UI paradigm anyway.
Most people have seen maybe three real 3-D movies from among: the Avatars, a Pixar movie, Hugo, The Hobbit, the Transformers one where they tore up Chicago, and... yeah, I'm hard-pressed to name another movie right now that was shot in 3-D... oh, and Drive Angry. Which no one saw.
The vast majority of movies offered in "3-D" were post-processed junk.