Kind of similar to Agentic coding. The code works? Yay, well done, AI. It't doesn't? You didn't prompt it correctly.
Like why can an LLM create a nicely designed website for me but asking it to do edits and changes to the design is a complete joke. Lots of the time it creates another brand new design (not what i asked all) and it's attempts at editing it LOL. It makes me think it does no design at all rather it just went and grab one from the ethers of the Internet acting like it created it.
Bingo. It just "remembers" one of the many designs it has seen before.
As far as hallucinations go, it is useful as long as its reliability is above a certain (high) percentage.
I actually tried to come up with a "perceived utility" function as a function of reliability: U(r)=Umax ⋅e^(−k(100−r)^n) with k=0.025 and n=1.5 is the best I came up with, plotted here: https://imgur.com/gallery/reliability-utility-function-u-r-u...
Wasted 1 hour each of your 5 co-workers who ended up reviewing unusable slop? Silence.
As with Marmite, I find it very strange to be surrounded by a very big loud cultural divide where I am firmly in the middle.
Unlike Marmite, I wonder if I'm only in "the middle" because of the extremities on both ends…