A Separate Kind of Intelligence
edge.org
edge.org
> It’s interesting that that isn’t an architecture that’s typically been used in AI.
No? That sounds exactly like training a model, then applying the trained model.
If contemporary AI/ML models behaved like what Alison Gopnik says, then their tendency to overfit would be even more of a problem -- you couldn't even transfer them from simulation domain to reality -- since they would lose all their plasticity overfitting to simulation!
Also, this article contains lots of other interesting ideas to think about. Highly recommend reading all of it.
I would even argue the LR is not relevant to plasticity, it's a meta-variable for training the model and not to do with the model itself.
A plastic model would be one that could accomplish a given task after being trained on it, and then trained on a second task while maintaining the ability to accomplish the first task.