If you liked this, you may also enjoy: "Back Propagation is Sensitive to Initial Conditions" from the early 90's. The discussion section is fun.

https://proceedings.neurips.cc/paper/1990/file/1543843a4723e...