Eventually models will likely get their creativity by:
1. Interacting with the randomness of the world
and
2. Thinking a lot, going in loops and thought loops and seeing what they discover.
I don't expect them to need humans forever.
1. Interacting with the randomness of the world
and
2. Thinking a lot, going in loops and thought loops and seeing what they discover.
I don't expect them to need humans forever.
Hallucinations are highly creative as well. But unless the technology changes, large language models will need human-made training substrate data for a long time to operate.