I'm a white male, but I grew up being called Gwailo, Gaijin, Auslander, and when I finally returned to the anglosphere in my early teens, I was still an outsider as I spoke with a weird accent and was by that point a through-and-through third culture kid. I got the crap bullied out of me, and eventually figured out that it only hurt if I took it to heart. I learned to pity those whose worlds were so small that they could only take satisfaction from being cruel to me. It was their problem, not mine.
Folks need to have thicker skin, and realise that not everything is about them. In fact, very little is ever about you, most of what people say and do are manifestations of their own thoughts and emotional issues. Physical violence is of course something that needs to be fought against (and this is why we have criminal justice systems which typically take this sort of thing perfectly seriously), but you can only be the victim of "verbal violence" if you choose to take the position of victim.