He used to say two things: that he has estimated to have taught at least 100 thousand people in his life (seems just crazy boasting, but feasible when you are working in 5-8 different schools per semester and each class has 100-250 people) and that a teacher is always teaching for the worst student in the class, and that the only reason that top universities are better is because of their selection process.
Forget class material, forget infrastructure and fancy facilities. What makes the best universities is the fact that the top students are there.
If you can not (dramatically) change your students and make them smarter, you can make your classes smaller and segment by performance. This at least stops your top 20 percentile from being dragged down by your bottom 20.