Apple Watch was basically originally marketed as a high-end app/notification device (remember the original 10k gold Apple Watch?) Over time they realized the real target market and use case was as a fitness/health tracker, and they doubled down on features and design for that.
With these AR/VR headsets, I agree that gaming is the one use case I've actually seen these headsets be great at, but all these companies keep trying to extend it to our daily lives that nobody seems to really want. But I could believe Apple would eventually come around to seeing one or two really good target markets (gaming and watching movies maybe?) and then just really hone in on that. Folks say games will be a tough sell because Apple isn't really known as a gaming platform, but I don't think this is really true if you take iOS games into account. I can easily see game developers wanting to build for this given the hardware capabilities.