Most of the time, most of us don't want to hurt others, or the consequences of doing so are harsh enough to deter you.

I like to believe that means that there are more of the former, and less of the latter.