I'd be willing to bet that if the mods took the time to find out who downmodded you, then they would have a few extra folks worth banning :)