Language Models Are Few-Shot Learners, They Just Can't Remember

The blog discusses a potential path to making LLMs self-referential and self-directed continual learners.

Solving continual learning is key to AGI - and we maybe close to solving it.