>> an LLM is completely opaque
And despite that, although they are not like that in practice as there are too many uncontrolled variables, with temperature at zero, for the same input they produce always the same reply.
And despite that, although they are not like that in practice as there are too many uncontrolled variables, with temperature at zero, for the same input they produce always the same reply.
Just because a black-box system is deterministic, doesn’t mean it’s understood.
You couldn’t predict the output the first time around, is the point.
Nonsense.
https://thinkingmachines.ai/blog/defeating-nondeterminism-in...
People often assume they are not because they can ask the same query to the same model and get differences in output, but wrongly conclude that this is some inherent LLM trait, instead of non-determinism added on top of it because of implementational choices that were made.
Of course it's not mysterious. It is well understood by all who are aware of the fundamental unreliability of all major LLMs in general use today.