I find that most extreme ideologies simply boil down to people not wanting someone to have any control over them.
They don't care for certain aspects of the social contract and want to be able to flaunt it at will with no repercussions. Or they don't want to pay taxes or some other thing. Whatever, they feel that society at large is what's holding them back, not simply a lack of ability or drive.
At least with religious fundamentalists or whatever flavor of totalitarianism you're comfortable with, it's clear what their answer to the problem of force is: be the force.
Anarchists have no answer to that. They want to "be free to do whatever" but when confronted with the question of what happens when I want their shit, they invariably create government. Oh, I can't take their shit because there will be rules. In the community they live, you can't live there if you take other people's shit.
Yeah. That's just government. That's politics. That's the social contract. We all agree not to do shit in order for us to live relatively peaceful, chill lives.
Government, in the broad sense, is not the problem. The problem is that governments are still run by people. And we're kind of fucked up. And we often make mistakes.