We trained our brains to know that we are going to 'trick' them with sight/sound all the time. TV, music in headphones, etc.
What VR doesn't do (apart from some of the weird Facebook prototypes you'll sometimes see) is affect any of the senses that actually make us feel immersed in a space.
So great, I'm looking at a beach and when I turn my head, it's still there. But it's 68 degrees in my apartment, I still feel the carpet on my feet, I still smell my partner cooking, etc.
It's honestly why a VR metaverse just seems so far away. My current problem with media is not that I can't see it anymore when I turn my head.