LLMs are deterministic in principle. It’s like JPEG where it’s a lossy compression plus some deliberate injection of noise to add variety.