We play video games that aren't anywhere near real life levels of realistic. IMO the main issue with VR is it makes you feel nauseous
In a lot of VR games you move your character around while you do not and that is what causes a lot of nausea. If games have to be like beat saber for VR/AR to be successful that’s damning.