A Mechanistic Interpretability Analysis of Grokking

related:

Grokking: Generalization beyond overfitting on small algorithmic datasets https://mathai-iclr.github.io/papers/papers/MATHAI_29_paper....