Pretty sure he's just referring to backprop[0] correcting weights more dramatically at one layer vs. another layer

[0]http://en.m.wikipedia.org/wiki/Backpropagation