I may be wrong, but comments are meant for that. Ideally when there's a disagreement, people can openly discuss it. I thought downvoting is to flag unproductive comments.
I had that impression too, but I just read the guidelines and can't find anything to that effect. They do say that we shouldn't be commenting about the voting though ;).