He's saying that as new data arrives, it has to adjust both ways, not only toward the correct answer.

(If that wasn't the case, you could just figure out which was the only direction it would move and then stop collecting data. You've already got your answer)