Meh, low-grade harassment to you might be completely acceptable conversation to other people, and that is the crux of the issue. Voting is used to identify bad-faith responses. If certain people can't handle responses which are in good faith, then I am personally glad that they are not participating. Those are not the kind of people that make good discussions anyway.