>The harder question, in Chollet’s framing, is: how efficiently can a system learn to do something genuinely new?
The more diverse stuff it knows, the easier it will be to learn something new.
The more diverse stuff it knows, the easier it will be to learn something new.
It is unclear if Transformers are "it" or not, because while they are much more general, they are also very spikey intelligences despite having read almost everything the trainers can get their hands on.