The data present in the conscious experience of human beings is something I've been thinking about a lot lately. It's definitely a very important part of the puzzle and it's missing from the training data, and it's not clear that it ever can be included. Leads me to wonder if the only way that AGI could ever happen for real is to have embodied, embedded, emotional agents that go around making mistakes and learning from them like we do?