Let's bring the subject back into focus: This is an example of an LLM being used to search a massive database of scattered text and files. Are you saying LLM's are not suited for searching through text?
That isn't how LLMs work. LLMs are statistical language models, not search engines[0,1]. They can be prompted to call external software to search databases, but they themselves are not capable of doing so, and more often than not they generate responses based on their own model, which may not be accurate. We've had technology that was capable of searching databases for decades without the quirk of not being capable of presenting that information accurately.
>Are you saying LLM's are not suited for searching through text?
I am saying that first and foremost they don't do that and furthermore that they are less suited as a substitute for that than what we had before. An obvious example of this is the AI feature of Google Search, which I've seen hallucinate results numerous times. But you can also look up the numerous times AI has fabricated citations when used in scientific research.
[0]https://medium.com/@himadri.abm/large-language-models-are-no...