"When you do anything from a clear judgment that it ought to be done, never shun the being seen to do it, even though the world should make a wrong supposition about it; for, if you don't act right, shun the action itself; but, if you do, why are you afraid of those who censure you wrongly?"
That said, I disagree with the statement. Different social groups have different norms, and those norms should be respected. I tend to make a large number of sexual jokes when around a particular group of friends, but those jokes would not be taken well by other groups of friends. It is not that the jokes are wrong, but simply that they do not work for everyone. To broadcast them to all my various social groups would be mean-spirited, and so I do not.
For the obvious reasons - that they are in positions of power over you.