Hacker News Reader

> A one word change to a prompt/spec will produce a drastically different program

So in other words, determinism (or lack thereof) is the hard problem!

A deterministic program must have the same output for the same input, but determinism does not restrict the outputs for different inputs

I think most people perceive program semantic not only to be defined for the whole program as a whole, but also towards individual subexpressions. If the "LLM compiler" changes the output completely when a single word is added, then it is not deterministic for the subexpressions, that don't contain that addition.

Granted that is not the rigorous definition of determinism. Also some existing compilers are non-deterministic with such a definition, namely when "undefined behaviour" would be triggered. That's precisely the problem with UB.

Obviously they are cryptographic hashing functions as they exhibit an avalanche effect!

Reply on news.ycombinator.com