A pile of GPUs who recently solved 10 long standing math problems. Those pile of GPUs are, in my ignorant opinion, smarter than the people we have running our countries [at least on an IQ basis].
"it generated a complicated math proof" doesn't mean anything in this context, because the prompt was uncontroversial, it was "try to solve this math problem".
you have your big fancy government LLM. one person wants to prompt it "generate a proposed peace plan with Iran" and a different person wants to prompt "generate bombing targets in Iran".
those two inputs can't co-exist. you have to choose between them. the process of making those choices is called politics. you cannot simply outsource it to a chatbot.