Do you think it's just frustrating in the Meta landscape? I've been playing around with stuff I find on the "Linux VR Adventures wiki" [1]
I've got a different, (not meta) VR HMD, and am running things using Envision and Stardust XR.
Excuse me if none of this applies to mixed reality.