Like when people went after J.K. Rowling for her "anti semitic depictions of jews". When she just made some greedy goblin characters and other people created the connection in their own minds.
Edit: “I would like them to say something like, ‘Any sentient creature from the material plane is like a human, in that they can be anything they want to be—good, bad, smart, or not so smart.’ And so races might dictate certain things like whether you have dark vision or a breath weapon, but they just don’t dictate your behavior.”
As in real life, so too it must be in fantasy, that the brain is the sole organ immune to genetics.