>There are still quite a few challenges to making LLMs work reliably.

I'm not unsold that AI will continue to improve but I'd be weary of this claim. LLM's reliably do what they are supposed to do and it appears they're reaching an asymptote in capability. If what you're wanting is a truthful chatbot, you're probably barking up the wrong tree with LLMs.

Do LLMs have utility? There's enough people on HN to convince me there are legitimate uses for them. However, many of the people using them are also the people desperate to legitimize their utility, so it's honestly hard to know. I personally have not found any application for LLMs in my life and would discourage anyone working on anything remotely mission critical from using them for code generation. But I've definitely heard of a few real world uses.