Yes, catastrophic forgetting is absolutely one of the problems that needs to be solved to enable something like this.

My broader point is just that there's nothing inherent to the structure of LLMs that stops them from updating their weights and continuously learning from environmental feedback in the way humans do, and there's already solid templates for how they could push even further in that direction.

But as an assessment of the current state, I agree with you, LLMs lag humans severely in ability to self-update.