It's not wrong though, isn't it? Amount of confidence allowing someone not to avoid confrontation essentially makes some people feel unsafe, perceive it as unpleasant and causes hate response.
To remain silent is often to implictly agree with an assumed group consensus.
Being proud of one's integrity doesn't actually diminish it, except in the eyes of those who are looking for reasons to diminish or relabel it anyway.