Would you have the same qualms if the AI's source were open and the public voted on which pull requests to accept?
Insert a layer of expert representatives (akin to congresspersons) to generate the PRs?
Making the system resilient doesn't sound like anything more than another engineering problem to me.
I interpreted @mtgx's statement as referring to the information that would be input into the IA. Namely that if presidents are getting bad advice from advisors already, replacing the president with an AI might not improve things, if the same bad advice is still being fed in.