Related paper:

“What learning algorithm is in-context learning? Investigations with linear models”

https://arxiv.org/abs/2211.15661