AI models act as a force multiplier for intelligence, in particular for generating information according to someone's wishes.
I.e. deepfakes and social media mis-/disinformation campaigns are a thing and having powerful AI allows you to do those at scales that can overwhelm society's resilience.
In general, even if you have "aligned" AI: aligned with whom or what?
Whom are you comfortable with lording as a some demi-god over you, dictating what to believe?