A Neural Network in 11 lines of Python (2015)

Your post was also popular in:

2017 (235 points, 26 comments) https://news.ycombinator.com/item?id=15498341

2016 (82 points, 16 comments) https://news.ycombinator.com/item?id=11378022

2015 (351 points, 42 comments) https://news.ycombinator.com/item?id=9886555

How closely related are modern "transformers" to this model?