There's no moat given that open source models are almost as good already. And it's yet to be proven that LLMs in particular can be reliable enough to actually provide significant return on investment.
Then there's the legal issue. People are not going to accept the idea of "you can't sue me, the AI decided", and so a not perfect model is not going to be deployed in any field of consequence, because the idea that you can offload liability on models is not going to fly, and is ethically reprehensible in my view and in the view of most serious people working in regulated industries. It actually introduces new legal issues, a jury is far less likely to side with an AI than it is with a person who simply made a mistake. There are numerous social reasons why the liability concerns here are legitimate and concerning and actually different for companies than if a human had been making the decisions.
Therefore, the models have to be perfect, or they have to be checked by hand by experts at every step (in which case, there is no return on investment, you haven't really automated anything).
That's the classic conundrum of "I may as well have done it myself given I had to check that code line by line anyway" I see in my own work, and the same is going to apply for non-perfect models in any field of sufficient consequence that there is a hope for profitability (and usually, these fields being consequential enough for potential profitability also implies a potential for liability).
Anybody that works as a programmer in finance/energy/healthcare/government or other parts of the "real economy" could tell you this years ago. The perception that AI could be used to automate significant work was dead pretty shortly after arrival. The only industry that continues on with the charade is the industry with a vested interest in selling and making dubious promises about AI products.
That doesn't mean I don't think LLMs are cool or that they are totally useless. For endeavours that were limited in their profitability anyway, it may very well have some use cases. I just don't see a viable business model for any large companies except Nvidia or AMD or Broadcom and others making money selling data center equipment. Maybe ads and agitprop, but that seems to be a sort of parasitic relationship going on with social media and the internet and one wonders how long it can continue before canabalizing itself.