But that hallucination is reproducible so you can adjust the prompt. Unlike an LLM in which everything is wildly not deterministic.
There’s a big difference between deterministic and smooth though. Typical LLMs certainly aren’t reliably smooth, so the small prompt change might product a large and unpredictable output change. I’m not sure if that’s any better with the typesafe approach.