> Models don't know anything across iterations yet.
Can you expand. They have both context and memory?
Can you expand. They have both context and memory?
I'm sure there are research prototypes that work differently from this but I haven't seen any enter the mainstream yet.
Also, diffusion language models have a different evaluation order but I think they also do not really have internal thoughts or feelings because they also do not seem to have any sort of hidden state that encodes anything like that.