A lot of people wear glasses without much objection. AR glasses need to be about the same form factor as regular sunglasses today.
Phones and tablets can leverage their size to pack bright displays, tactile controls and large batteries. Targeting the Ray-ban form factor is going to require some ugly sacrifices, and even an optimal solution is going to be a hard sell compared to the miniaturized technology of it's day.
I keep hearing the "make AR glasses" shtick, but I don't think there will be real demand for it. You either wear the heavy, light-blocking fighter-pilot headset for full immersion, or you get the dinky 15 degree FOV washed-out Google Glass. And both of them cost a mortgage compared to the smartphone.
The greatest trick the devil pulled was convincing the world technical limitations don't exist. Flying cars sound cool, until you consider every single logistical limitation that prevents it from being a commercial reality. Yes they exist, but are they practical? Will they ever be?
This slightly reminds me of when my grandfather told me not to get into computers because no one wants to stare at a screen all day.
Maybe the next generation will have less resistance to the idea?