The ability to downvote isn't correlated with anything besides the frequency of your posts/comments.