Chinchilla Scaling: A Replication Attempt

Yesterday's discussion: https://news.ycombinator.com/item?id=40077023