I don't think they ignored gaming; they just knew they would fail if they designed a gaming-first device.
Their best bet to bootstrap the platform is to make it computing-first around the iPad platform, and that means leading with multitasking, AR/MR, and with computing-oriented inputs.