Is the opposite also true? Is the upvote button not an "I agree" button? If it is, then the opposite is also true. Otherwise there really isn't a point to the vote buttons.