Building better search tools is one of the most directly interesting applications of LLMs in my opinion.

I'd put it like this: RAG = search engine, but sometimes hallucinates

RAG + deterministic quoting = search engine that displays real excerpts from pages.

Yes, and Dropbox is an rsync server.

A good, automatically run, privacy preserving search engine that uses electronic medical records might be a valuable resource for busy doctors.

I think the hope is that the LLM would find the needle in the haystack with more accuracy. But in jobs that matters, you check the results.