Do you not understand how much you weaken yourself when you allow yourself to believe this?
Legitimate criticism is the cornerstone of improvement. The only people who don't want criticism to be aired are those who are not genuinely interested in making things better, but rather benefit from them remaining bad.