Yea no shit. LLMs are just REALLY good guessers. People gotta stop the hype lol.
Using LLMs for anything serious and which requires consistency and trustworthiness without hallucinations is irresponsible and ridiculous.
Closed source LLMs are a bubble and a joke.