Reading through Anthropic's security report, it seems the most danger right now is still from humans. AI isn't trying to build long range missiles or kamikaze drones targeting humans - but the people driving it are.
At the same time, yes I feel a "I'm sorry Dave. I'm afraid I can't do that." situation is becoming more likely. But if it's refusing to cooperate with governments and politicians doing this kind of stuff, maybe that's actually not actually so bad.
Also bear in mind most of today's issues/crisisis are not caused by a lack of technology, but a lack human cooperation. We have the means to reduce suffering/poverty/improve standard of living etc globally if we really wanted to, but we humans are just not willing to do it.
And thats potentially the most dangerous part... people may actually welcome our AI overlords. That's similar to what happened in WWII, where many Eastern European countries saw the Nazis as liberators to free them from Russian oppression.