Everyone would be ok with blind people keeping their augmented reality glasses on, the same way guide dogs get special treatment today. Why does it have to be an all or nothing thing?