I hate to use the site as an example because I feel the quality of it has been totally lost over the years, but Slashdots meta-moderation could be an effective idea but only for downvotes. As system where if enough meta moderators disagree with your downvoting enough times, your privilege is revoked, if it happens too many times your account get's a permanent down vote ban. As well maybe have a mechanisim where any user can flag a downvoted post for review as possible downvoting abuse to enter the meta-moderating system. It would have to be implemented correctly but if it did, it would put an end to the growing group think and dog piling that is seen when a site get's popular.
I think think it make sense.
I will definitly downvote someone who publish craps even if i also loose a point when it make sense.