It seems like consumers just don't want VR/AR. We've had compelling experiences for a decade. But it seems like only a subset of console gamers, already a small population, care to buy a VR headset.
Besides, in some genres, "X but in VR" can make for a very big difference. Space and flight sims - even very arcade ones - are a prominent example. The ability to actually look around and track enemy craft easily is huge - I wouldn't even consider playing something like Project Wingman without VR anymore, even though it is available.
I would be very surprised if Apple releases a device that has those problems.