It looks to me like Microsoft is trying to position HoloLense to scratch that particular itch... They could potentially have experiences like the original Surface table, but using AR over a normal table, rather than an active table.
It would sure be weird to walk into a meeting room, and have everyone put on their AR goggles, but if it turns out to be really effective, it could be better than a Surface table in many ways.