My personal prediction - smart glasses as a smartphone replacement, AR/VR headsets as a poweruser workstation machine replacement.
The market segments map out nicely with your prediction as well - almost everyone has a smartphone of some kind (just like i expect almost everyone to have some sort of smart glasses in the future), while a relative minority (even though it is a large one) has poweruser workstation machines (just like with AR/VR headsets in my prediction).
That is, until at least the tech gets insane enough to allow packing full functionality of an AR/VR headset into the form factor of glasses, with an insane battery life to boot. I don’t see that happening in any foreseeable future though, sadly, barring some transformational and unexpected battery chemistry breakthroughs.