That reminds me of the article „a neural network in 11 lines of code“ from 2015 (although not on MNIST, rather some kind of XOR)

https://iamtrask.github.io/2015/07/12/basic-python-network/