I get simulation sickness even from games I play on a 1080p screen from an arm's length away. I couldn't stand a 3D-glass for more than 15 minutes and therefore I'm too afraid to even try the VR headsets more than ten seconds (It gets really bad when it starts with a splitting headache and nausea combined).
However, I feel like I'm in the minority on this. No one around me seems to have any trouble watching movies in 3D, for a start.
I guess, just as some people aren't fit to operate a vehicle (problem in eyesight or other reasons) there are some who aren't fit to use VR and I really doubt they (we) amount to the mentioned 50%.