“We don’t understand why neural networks work” is a myth. It’s not a miracle, it’s just code, and you can step through it to debug it the same way you would any other program.
Sure, you can "step through" a neural network but all you'll ever see are arrays of meaningless floats moving around.