VR headsets look dorky and isolate you from other people in the real world. I'm inclined to agree with you that's probably enough to mean it will fail to ever go mainstream.
Ironically, AR/some better Google Glass might be a hit, if it didn't look so stupid and the people pushing it were less hated. Wait until TikTok makes an AR headset and gets K-pop groups to promote it.