It's definitely not the pattern that doing worse once snowballs inevitably into future years, at least not on average, because students' scores still always assemble in a nice bell curve.

I think a better model is that you are not likely to stray too far from your "true" ability, since even if you forgot (or missed) everything from previous years, you could still learn a certain amount in just one year (and probably you remember some things).