Some people like VR but they use it at home.
On the other hand, earbuds and smart watches haven't had the same issues.
As it was, wearing a Google Glass was making several statements: I have acccess to this special thing; I'm going to wear this mostly useless object in a highly visible location on my body; and if actually using it in public, I don't care that having a one-sided conversation with a computer annoys those around me (kind of like talking on a phone/bluetooth headset, but worse). Maybe the camera was the anchor for the issue, but I don't think it was the real issue; I don't recall seeing articles about people being shunned for wearing the Snapchat camera glasses.
If/when we have AR glasses that are reasonably priced and genuinely useful, I'm inclined to think they'll be broadly accepted. Yes, there will be people including some of the people reading this who will be upset about the panopticon-like invasion of privacy associated with always-on cameras everywhere. But they'll be largely ignored just as they are today with respect to video/photos being just a smartphone in the pocket away.
It's easy to forget that less than 20 years ago taking a photo, much less a video, was a pretty deliberate act involving equipment that most people didn't routinely carry with them.
Google Glass was just too sudden a change. Another decade of eroding our collective sense of privacy and boundaries means it might be more successful now than it was back when we still had some expectation of personal privacy.