I can't recommend enough this "backpropagation from scratch" from heremy howard (fastai) where he implementes backpropagation from scratch using python.
UPDATE: link https://www.youtube.com/watch?v=CJKnDu2dxOE
UPDATE: link https://www.youtube.com/watch?v=CJKnDu2dxOE