Large language models aren’t magic, they are tools. Most tools are potentially harmful in the hands of a novice and potentially powerful in the hands of an expert.
These tools seem like a needless middleman, for the most part. We'll see in ten years. Because ten years ago it was self-driving cars around the corner, and now we have the models saying full chat and knowledge providers are around the corner. I'll be very surprised if the edge cases, where stuff actually matters are ever addressed beyond demo uses or marketing/advertising applications.