The central problem with math is that you have an infinite amount of space within which to move these goalposts.
How many variants on this trial before we find a mistake?
What is an acceptable error rate?
How many variants would it take for a human to make a mistake? It's certainly not "infinity", so is this an indication that humans don't reason?
https://mathstodon.xyz/@tao/113132502735585408
"Here the results were better than previous models, but still slightly disappointing: the new model could work its way to a correct (and well-written) solution if provided a lot of hints and prodding, but did not generate the key conceptual ideas on its own, and did make some non-trivial mistakes. The experience seemed roughly on par with trying to advise a mediocre, but not completely incompetent, (static simulation of a) graduate student. "