So for them, winning the power game is the whole point. Saying nothing and changing the channel makes them the loser. Making you shut up makes them the winner (in their view).
Power? No.
Society enforces its rules. Get over it. And PC is about rules which generally enhance peace and cooperation. Being at the receiving end of a racial slur rarely puts someone in a peaceful and cooperative mood...
"Gonzales: There is one question, Inspector Callahan: Why do they call you "Dirty Harry"?
De Georgio: Ah that's one thing about our Harry, doesn't play any favorites! Harry hates everybody: Limeys, Micks, Hebes, Fat Dagos, Niggers, Honkies, Chinks, you name it.
Gonzales: How does he feel about Mexicans?
De Georgio: Ask him.
Harry Callahan: Especially Spics."
This wouldn't be funny without the taboo that was strengthening at the time.
No, today's PC has nothing to do with anything "peaceful and cooperative", not when it consigns to perdition all of us white heteronormatives in fly-over country, probably more than half the country. It has no limiting principle, is frankly totalitarian, and the end game is going to be arbitrarily ugly.
Sounds downright smart.
It's objectively clear a large fraction of this nation hates me and mine. They're quite clear about that, and have no shyness in expressing it, and a bit too frequently express where they want us to end up (see below, hate is unwise).
I, at least, don't hate them in return, that's unproductive, clouds the mind, etc. Which gets in the way of many things; the more dire being effective self-defense if the current trends, e.g. social, moral, and financial, continue. Which it's hard to see how they're not going to, their being baked in the cake by now.
Just imagine the worst nickname anyone ever gave you, and having it replace your real name. That's about the level of rage people can feel about "nigger", "Injun", "raghead" or whatever you might imagine.
If you are transmitting over a channel where some amount of politeness is the standard, violating this standard will and should have consequences.