> But still, downvotes = disagreement,

Nope, downvotes can be for many reasons, disagreement is not required to downvote. (I often downvote comments that I agree with and find non-useful in context, and upvote comments I disagree with but which contribute to productive discussion.)