I think that the concern about LLMs making up information are absolutely valid, and a serious concern. At the same time, I think most people focusing on those concerns aren't thinking much about the alternatives, namely Google.
For many people, Google results have gone from being an absolutely amazing demonstration of what could be done if one had the resources to crawl and process the entire internet to a complete waste of time at best, clogged with spam and nonsense and misinformation. I've been using Duck Duck Go for years now, and recently my middle-schooler switched to Duck Duck Go because I got answer to a question she had already asked Google before checking with me. Some people even pay for Kagi search, because Google is just that bad.
So LLMs don't have to be perfect to be better than the alternatives, not even close.