I recently spent some time learning how backpropagation works and wound up putting together this step by step tutorial that you might find helpful: http://mattmazur.com/2015/03/17/a-step-by-step-backpropagati...