This is also called the euphemism treadmill. Over time almost any word assigned to a social stigma will become pejorative. The word retard used to be the only way to refer to the "differently abled" in polite society.
Which I think is a pretty solid argument for not using those words, unless you're cool with frequently hanging the threat of murder over <insert minority>'s heads. Personally, I'm not cool with that.