> An LLM can only ever reproduce what it has seen before.
Anyone who's played around with these models know that at least some generalization is taking place.
Anyone who's played around with these models know that at least some generalization is taking place.
Humans don't come up with ideas out of nowhere. Open a novel and you will find that even though the overall work is unique, it is composed of tropes from other literature and experiences from the author's life which have been generalized into another context.