The problem is that that is never, ever, where it stops. There's always people that society suddenly decides are "really important", usually the most dumb-witted, cruel abusers you can come up with.
And of course, the rules don't apply to them. Just look at the president of France, if you want to see a particularly bad fuckup. He, and his wife, have confessed, publicly, on TV, repeatedly to having a paedophilic relationship, where she abused her job to fuck children (she was even cheating on her husband doing it). He was 15, she was 40 years old at the time. Not only have they not been sued (in France, both would be punished)
Needless to say, a whole bunch of people were sued for stating this during the campaign, as well as for a bunch of other negative things they said about him.