Note that the "they" who published the counterexample on X is some rando mathematician (Levent Alpöge) working for Anthropic, not Anthropic the organization. He posted the counterexample in a tweet -- reason enough for "not disclosing the LLM chat session". There's no reason to think that it won't provided if asked for, but it hardly seems relevant.
My guess is that the chat will look similar to a full transcription of a (multi month?) discussion between a few mathematicians. Full of dead ends and stupid errors (bit by the human and Claude) that would be embarrassing. We all know how bad it is, and we prefer to keep it behind the curtain.
Who knows what "rewritten" means, but you can sort of see how it progresses.
Counterexample: 35 + 6.
Trusting AI math is not an issue here. It's as if you had asserted that no primes when divided by 35 produce a remainder of 6 and the model said that 41 is a counterexample and then you complained about not being able to trust AI math.
P.S. As someone else noted, your AI query was malformed ... no prime is divisible by 35, nor is any integer divisible by an integer with a remainder of 6 -- divisibility implies a remainder of 0. So perhaps the AI simply took what you wrote literally.
Why do you trust a random stranger so much? Will you hand over your car keys to a random stranger? Sharing the chat will take 30s of their time.
> There's no reason to think that it won't provided if asked for
But they didn't provide it.
A) Claude really produced this counterexample
B) A mathematician working for Anthropic solved a problem mathematicians have been working on for more than a century, and then credited it to Claude for PR purposes
If you believe B is more likely, why would you then believe a proof in the form of a chat log, when said chat log could itself have been faked by Anthropic way more easily than solving the mathematical problem in the first place?
I don’t believe a mathematician produced the counter example secretly, but how much did they contribute to the result?
AI isn’t magic, so to evaluate the value delta, you need to know the value of the input.
These kinds of results are interesting for LLMs because mathematicians have been working on them for decades. If the result doesn't already exist, there's no way it's in the training data, and if mathematicians have been unsuccessfully tackling the problem for decades, it is believable that the use of a new tool made the result possible, even if guided by a great mathematician.
Are we talking a bicycle, powered by a human stepping on the pedals; or a rocket that will fly to the moon on its own with people inside?
Don't you want to know? I mean, doesn't everyone want to know?
If I am not mistaken, all of the flurry of novel results has come from existing mathematicians. This makes me suspect that the models aren't at the level where just any layman can get results. They require a skilled human in the loop to keep them on the rails and to properly explore the solution space.
Though not everyone who works in the sausage factory still wants to eat sausages.
because they are using the same prompt to try finding other counter-examples. they are milking it
Why do you make false claims and attack strawmen so much?