The solution to that is to make the vote scores logarithmic.

Removing information helps nobody.

If you're trying to prevent the wrong sorts of attractions, you might also try it on a selective basis. For example, if a thread hasn't received a vote in the past hour or day, or if a user isn't logged in and can't vote, you could continue to display the votes in that thread.