That's not what I am worried about at all.
I'm worried one of the 79 year old toddlers we have these days in charge of some powerful nuclear armed country says "gee, this ai says I should attack right now, boy is it smart, glad I bought the stock ahead of contracting the government with this company I can scarcely understand!"
That's not what I am worried about at all.
I'm worried about the 40-60 year old businessmen wrecking the prosperity and security of millions while chasing higher investment returns, because they've finally been freed of many of the technological constraints that kept those impulses in check.
The danger is upfront : if there is a group of people insane enough to set up a system where there is no such chain. (As lampooned in Kubrick's Dr Strangelove (1964), in particular on the Soviet side.)