If that pivot happened it was well before Microsoft ever announced the HoloLens. Enterprise-focus was a big part of their marketing from Day One and consumer/games relevance was always an afterthought in their demos/marketing.
I think Microsoft didn't have the confidence that it could be a mass market/consumer device at its price.
(It is interesting that with the Disney section of the keynote, Apple seemed much more directly was flirting with consumer/mass adoption.)