Isn't this part of a different problem of not being allowed to be wrong? It has major impacts on racism (and sexism and other forms of discrimination) making it worse, but also is a factor when someone is wrong in other areas of life and can have negative impacts because owning up to a mistake is something our experiences have taught us to avoid. Why is it that we have a shared experience that you should flee a mistake instead of owning up to it? Is fleeing, or sometimes just outright ignoring, a mistake seen as a more socially rewarded action than owning up to the mistake?
One area to look is politicians apologizing for being wrong and the extent that is treated a weakness by their political opponents.
I think a society where the better choice of action is to own up to a mistake makes for a better society.