So what are GPTs missing?
I've got:
- Falsifiability - am I saying something false? Some products have an output checker, but it's a bolt on at this time for unacceptable output, which is not the same thing as falsifying.
- Agency - much ink already spilled
- Context Window size (too small, or need to summarize parts of the context to fit in context window, and know where to go back to for full context)
- Directed Self-Learning (I'm sure there are things like this that people may point out, but some kernel of self-learning isn't there yet)