In my experience at one of those traditional institutions, those experts often couldn't care less about any responsibility to undergrads. Their job is to do research, and to get grants to support that research. The number of professors for whom teaching was clearly a nuisance was one of the most depressing parts of the experience.
Having similarly capable peers is really the primary advantage, especially if those relationships carry on after you finish.