Who would apply those rules to the mods? Rules aren't magical, bolts of lightning don't shoot down from the heavens and obliterate the offending moderator. If only.
Who do you report mods to? Other mods?
There is no one to report them to.
The trouble is that people demand that the discourse remain pleasant and unobjectionable. That it drives on in a direction that they agree with. And good, human conversation can't ever do that. We have unpleasant things to discuss, and we have objections. The direction can and should be capable of changing at any time.
But because most people are cowards and children, you strive like little eusocial insects to deconstruct and destroy conversations like that. It bothers you. And the biggest and best tool for that is the moderator, some unintelligent busybody with grudges.
Until the one day of course that you yourself realize the there is something unpleasant to be said. Until the direction should be different. Until there are objections to be made. Then you get banhammered and you want to cry about the very juggernaut you helped to enable.
The confusing part is why you think that the solution could be an ever larger juggernaut? Why do you think that could ever help? How do you even propose creating it?