It's literally impossible. That's a key part of https://en.wikipedia.org/wiki/Chaos_theory ; in formally chaotic systems (of which there are many), the uncertainty in a forecast increases exponentially with elapsed time, which means it's impossible for an AI, no matter how smart, to predict very far ahead. People who believe otherwise are engaging in magical thinking; like "intelligence" is some magical quality that allows one to break the laws of the universe, do the equivalent of sorting a list in O(1) time.
While it may never be able to “perfectly predict” at Resolution X does not mean it can’t perfectly predict at Resolution <X. We already have good predictions of human behavior at some resolutions.
To put it another way; there are two ways to approach infallibility: be uncomputably intelligent (AIXI) or bulldoze/terraform/grey-goo the Universe into something very predictable. An agent smart enough to understand both options and how reality works is likely to choose the physically realizable option.
Only careful choices of goals that value human flourishing (AI alignment) will avoid optimizing us out of the picture.
I’m being snarky but you keep commenting on these posts with imo intentionally naïve comments.
People will make super smart robots if they have the tech and there is no regulation stopping it. Why people are pretending this is some far out inconceivable idea ? Denial ?
But I agree there would be limits to things like batteries. I don’t entirely disagree with your points either. I just don’t imagine any of this is insurmountable if super intelligence becomes reality. Personally I think we’ll create this reality through military application before any AI does.