On the other hand, it's interesting we do this over and over again (pejoration). Innocent words associated with disadvantaged groups start to become derogatory, are mostly abandoned from polite use to describe people in that group, but then become okay to cast around casually in other contexts.