I wonder if that quote is still applicable to systems that are hardwired to learn from decision outcomes and new information.
1. Past decisions and outcomes get into the context window, but that hasn't actually updated any model weights.
2. Your interaction possible eventually gets into the training data for a future LLM. But this is incredibly diluted form of learning.