Not denying your experience in any way, just want to remark: I heard (and felt) similar takes regarding a lot of "negative" properties from a lot of different people. Height, weight, race, gender, hair color, stutters, country of origin and even really specific stuff like big ears.
Might be helpful to consider that most people feel like they have two strikes against them already (some of them being more right in their assumption maybe).