The damage of not removing an invalid score is that that score may be impossible or require superhuman skills (i.e. TAS) to attain, thus forever removing that category from competition.
This lopsidedness - and don't get me wrong, a healthy dose of schadenfreude too - makes me strongly believe proven cheaters should be stripped of all records.
If you're dishonest enough to cheat once, why should we expect your other records (both past and future) to be more honest? Once you have been caught cheating, that knowledge colors all of the other records, and you have a stronger burden of proof to demonstrate that those records are indeed valid. If that means that we are stripping you of legitimate records, well, maybe you shouldn't have broken the rules if you didn't want to suffer the punishment.
[1] In absolute terms. Of course, cheaters also get more ways to cheat over time, so the relative capability of cheaters versus anticheat detection will fluctuate over time.
I'm not sure how you can differentiate the punative nature of banning someone from all future tries because they had cheated indeterminately in the past, but not invalidating all their historical record outside of individiaul cases...
They did not forfeit their legacy, and in fact the very next year came within one game of competing in the World Series.
That way a game isn't killed forever because an unverifiable run got a perfect score.
Are there good records to determine that it isn't suspect?