I have not gone to graduate school at a place like MIT or Harvard, but I have done graduate work at both a top 30 and a top 60 school. There was absolutely a difference in quality of research, professors, and coursework at both schools (STEM subjects, and the top 30 school being higher quality).