The most despotic and scary governments of history would probably like a word with you. Maintaining a believable pretense of following any rules is a luxury we take for granted in many countries today, but Mao and Stalin didn't worry about the appearance of propriety.
Not really arguing against your main point though, I think you're right. Just don't forget how bad totalitarian governments can be.