I suspect even some of the more "advanced" queries they demoed off, i.e., "what was that restaurant John and I talked about last week?" also not require LLMs whatsoever and could have been accomplished with a simple search.
Though I do agree that the ML-based NLP thst we have today is much more usable, albeit more compute-expensive.