The current stumbling block is that the tech sucks and the headsets are enormous. If someone got it into a lightweight pair of glasses or contact lenses, the use case is obvious, and it would be a big of a shift as the smartphone.
Denying this is like being the guy in 1993 saying “why would I want a computer in my pocket? Am I going to work on spreadsheets on a tiny screen in the bathrooom? And where would I plug it in?”