Or it may very well turn out to just be a next key lookup which is 100000x cheaper to compute than probabilistic inference.

The vast amounts of energy spends on generating text tokens while biology only consumes a fraction of it makes me hopeful.

My bet is on the deterministic model. When one appears, the whole Jenga tower of AI comes crashing down if everyone can do it dirt cheap.