Many phenomena have been discovered unintentionally and/or without understanding them. Deliberately developing an agi would probably be easier with a better understanding of cognition, but it's almost certainly not required.
You can't ban compute. Here: 5 + 5 = 10. Might as well ban writing, or drawing.
The cat's out of the bag. Now that we all know AI works, every country in the world will have theirs. No one has a monopoly on math, no one can regulate it. Especially the US and especially Silicon Valley. That's what they do. Silicon Valley brought you the personal computers, the Internet & web, the smartphones and now AI.
And as for the compute bit of your comment, yes you can. You can outlaw financing of these ventures. You can prosecute the researchers for doing the research. We have these mechanisms. There's ethics boards.
Will LLM kill us all and rule the world, no. Will LLM kill some of us because someone decided that they are cheaper at taking vital decisions ? I’m pretty sure it’ll happen.
> Yes, DO ban all AI research and investment
So do you think it's a threat or not?