The other way around is much worse. The slower students get frustrated as they fall further and further behind until they feel it's impossible to catch up and give up.
Unfortunately most teachers teach at the level of the more advanced students, not at the level of the slower students. I don't know if they mean to do this, it might be unconscious, but they definitely do it.