I have found in my time teaching people about deep learning that proper visualizations of algorithms can help people grok things better[0]. Granted backprop and neural networks are really simple one dimensional algorithms.

[0]: http://blog.chewxy.com/2016/12/06/a-direct-way-of-understand...