There is zero chance that strapping a giant rectangular box to your face is going to considered anything other than very weird by the majority of people.
As a (so far happy) Vision Pro owner, I completely agree with you. However, I remember when they launched the AirPods how just so immediately repulsed I was by that thing, how I truly felt like it looked like a tampon coming out of someone's ear, yet somehow, here we are. I grant you that this is, to put it mildly, a bit more of a stretch. But if somehow wearing VR glasses (don't care what apple says, these are VR glasses) will become mainstream, something tells me they'll be the ones to pull it off.
They still make everyone look like tampon cybermen. (I own two pairs)
I was skiing last week, where ski goggles are the norm... So yes, currently it might be weird, but things change. Did you watch or read "Ready Player One"? There it is the norm.