I've seen this is a problem on Reddit, though I've never really noticed it myself. Someone decides the dislike or disagree with you enough, or perhaps they were just pissed off with the way you responded to them and they go through your history down-voting everything they can.
I'm just curious can you even down/up-vote old comments. Seems like they should lock after a few days to prevent this sort of behaviour.