This would only work if people were also incentivized to post good stuff about you; for example on Ebay, even if you have a dick downvoting you unjustly, the amount of good feedback will probably make it up. But here, there's none of that.