Here is a definite scientific nail down and solve for non-determinism in LLM outputs (Mira Murati's new outfit but really credit the author)
https://bff531bb.connectionism.pages.dev/blog/defeating-nond...
https://bff531bb.connectionism.pages.dev/blog/defeating-nond...