That would be a nice feature. Or much like a "report" button on some platforms, if clicking downvote meant you had to say why you had disliked, and it gives you the usual moderation options, all the other comments that it could auto-upvote, or a free-text field that automatically creates a comment... that would probably be the least-friction way of dealing with it.