No, the problem is that you’re thinking of this like Spock - purely logical. Humans aren’t logical. We absolutely trust/distrust each another based on appearances and mannerisms. This is not limited to RMS.

People are prejudiced, plain and simple.