SQLite FTS could have done this a decade ago. We've had good local search capabilities for
two decades and they either been underused or abandoned (e.g. Google Desktop, Yahoo! Search). This may be a reasonable projection of where AI is headed. You can do a lot locally but there is too much incentive to centralize around cloud infrastructure, then the privacy concerns make that prohibitive and we end up with what feels like a false choice of cloud or bust.
Maybe it's LLM hype that will bring more powerful capabilities to the desktop?