In my mind, LLMs are lowering the barrier of searching in the same way Google did in the early 2000s. Back then, you had to very specifically tailor your search key words, not use words such as "the," "a," etc. Google eventually managed to turn queries such as "what's the population of Ghana" into ready-made answers.

LLMs do exactly that for more complex queries, with the downside of possible hallucinations. Suddenly, instead of doing a research on the topic, a person looking to become "a programmer" asks ChatGPT to create a syllabus for their situation, and possibly even actually generate the contents of the syllabus. ChatGPT then "searches the internet" and creates the response.

I have gained confidence that LLMs won't be much more (at least in the next couple years) than search engines with the upside of responding to complex queries, and downside of hallucinations. And for that, I find LLMs quite useful.