> People are not. Humans have an inner world and subjective experience. Humans learn through their experiences, not just backprop.
https://en.wikipedia.org/wiki/Philosophical_zombie
But this is complicated and takes us sideways. Let's say somehow we can determine if LLM has inner world or/and subjective experience. Will this new gathered piece of information affect your estimate of upper bounds of LLM capabilities? It does not affect my estimate.