1,320 karma · joined August 25, 2019
OpenAI sat on the results so they could drop 10 at a time. It's rumored that they are sitting more results: https://mathoverflow.net/questions/513818/a-serious-challeng...
So not only are we not going to get boatloads of results, we're only get as many results as necessary for OpenAI to market their models.
If it works better here than for programming, then I would guess it's because you can give it a very precise prompt, so you either solve the problem or you don't. If you read the prompts people have shared for problems like this, then the instructions are basically "Solve this problem. Don't give up early. Don't solve a similar problem."
The sofic groups question was the outstanding question about sofic groups. Almost everyone thought that non-sofic groups existed, and there were plausible candidates, but proving a group was non-sofic was out of reach. Now that we know how to do it once, we can probably do it a lot more.
The Connes rigidity conjecture I think people thought was false, but it was a provocative claim to make. The significance of conjectures is frequently not that the answer to the question is "yes", but that we don't know how to answer the question. And now, apparently, we do.
The reason the author is upset is not that the conjectures were false, but that an AI settled them. That's why so much of his post is about the loss of the human element.
It was really more of a roadblock. If you had an example of where it was false, you could give examples of other things, so various questions required resolving the Jacobian conjecture.
One thing that he mentions that already quite surprising is that AI was able to autoformalize the Golod-Shaferevich theorem and proof.
That doesn't rule out an AI that makes a genuine breakthrough. If there's some new branch of math that no human has even imagined that answers the Riemann hypothesis, then that is exactly how I would expect it to go.
Before AI, it was pretty rare that a problem that turned to be unexpectedly easy, so mathematicians thought they were pretty good judges of it. (The last pre-AI example I can remember is the Gaussian correlation conjecture.) So thanks to AI we have learned that we were overconfident in our ability to judge difficulty.
If a truly major problem falls, like the Riemann hypothesis, and the proof turns out to be 10 pages, then the lesson will be a different one -- mathematicians are bad at math, and they should turn to more natural domains for them, like folding and putting away towels.
Of course people tried hard to solve them all, which is why it's so surprising that they were open. If anything, the solutions have gotten easier. The unit distance graph solution relied on a famous theorem remote from graph theory. The cycle double cover solution relied on a standard theory in graph theory. The solution of the Jacobian conjecture required nothing beyond knowing the definition of the Jacobian.
We're just surprisingly bad at judging the difficulty of problems. It's probably something psychological. It's even a known phenomenon, where someone will be stuck on a proof, someone else will announce the result, and the first person will suddenly get unstuck on their proof and produce an independent proof of the same theorem.
At this point the advantage of AI is that it's read the entire mathematical literature, and it doesn't have to worry about wasting its time. The solved problems have all turned out to be surprisingly easy, so the real lesson is that we're bad at judging how hard problems are.
Assuming this state of affairs lasts, the medium-term problem is that you learn something when struggling with a problem, even if you don't solve it, and if mathematicians become too reliant on AI the skills they develop through struggle will erode.
The long-term problem, of course, is that it seems much more probable that a future model will make mathematicians all obsolete. But so far Fable hasn't. (Anthropic has probably burned a billion tokens on the Riemann hypothesis already, without telling anyone.)
This specific counterexample really is trivial. There's nothing to cite. People have wasted hours and hours on a question whose answer you could give as a homework problem in Calc II.
If it was the professor, then that would be very embarassing on his or her part.
The idea that mathematics has rejected any notion of utility is absurd. It's not like topics get picked at random. Conjectures like this are interesting because they are a test of our understanding. The problem sounds easy, but apparently was quite hard.