That's not what downvotes are for (unless you're on Reddit). Downvotes are for wrong or misleading comments. If something is against the rules it can be downvoted and flagged. If you disagree, just move on, ignore the comment. If you support/like a comment, upvote it.

This is at least how I see it on HN.

Edit: Downvoted, sigh.