This feels similar to the advice I give my kids. When they get into circumstances where fighting feels like an option, I remind them to "use their words". I try to emphasize that not everyone they meet will "use their words" and that the smarter person should.

The down vote seems similar to me. Instead of down voting, try using your words. And when you're down voted, use your words. A down vote is a lost opportunity to extend the argument. It's an absolute with no explanation in of itself. In my opinion - worthless.