Possibly the original X tweet that popularized this list? 2024, 876k views

https://x.com/keshavchan/status/1787861946173186062

In my opinion, whether it was actually by Ilya or not is not worthy of debate. Many of them are widely recognized for being good pedagogical resources (e.g. annotated transformer, unreasonable effectiveness of RNNs, understanding LSTM networks), and others are landmark papers which anyone interested in the field would benefit from reading:

- Krizhevsky et al. (2012) introduced AlexNet

- Bahdanau et al. (2014) introduced attention

- He et al. (2015) introduced ResNet

- Vaswani et al. (2017) introduced the Transformer

Other papers are more specialized. Of them, I think Kaplan et al. (2020) by OpenAI is probably most important.