So no, we're not going to do that. Sorry!
First, there are more comments that are either factually wrong or interpersonally toxic than I have time to reply to. Downvoting is quick.
Second is the recursion problem. If I downvote and reply "factually wrong", then some people (either trolls or mistaken) may downvote my reply and say "no, you're wrong!" To say the least, that doesn't lead to a productive conversation.
And I have no way to respond to a downvote.
or maybe you can select an option when you downvote.
toxic/trolling, factually wrong, etc.
In most open discussion areas, Jerks and Ideologues (read very opinionated) exist, along with the humble people, who if they're lucky aren't having or at the end of a real bad day. Such that it is, some people won't invest much time to read carefully or really take the time to consider counter views if some of the comment conflicts with their world view on the topic. However on the other hand, some post comments seem to be nowhere near or relevant to the discussion, and certainly deserve a down vote.