1,448 karma · joined June 24, 2021
Both OpenAI and the researchers know if the sessions in questions were subject to data sharing. Why neither the scientists nor OpenAI is clear about that is weird - it would seem at least one party has the incentive to report that. But even if their sessions were in training data sets its hard to tell whether it influenced the outcome. Those models are big, but are they big enough to preserve subtle, niche techniques enough to draw from them while solving a related problem? Probably nobody knows.
Did the researches opt out from data sharing on subsidised subs?
Did anyone prove that their methods enabled OpenAI models to produce the solution?
For a discussion about science, there is almost no scientifical method applied to proving anyone stole anything.
Most people do not understand that the main reason for the subscriptions is to give OpenAI and Anthropic the priceless, unique data that shows how the models are used, what people are building, how they are building, which solutions they consider OK, which they consider bad -- they purchase this data with cheap tokens. This is their only moat, really. If some really proprietary IP gets swept in the training data set its not really OpenAI's fault -- its the researchers'. Have something secretive? Dont fricking paste this into chatgpt. Duh!
(I'd definitely not think OpenAI/Anthropic ignore the opt outs, or ZDRs. All it would take is one whistleblower to get them into terminal troubles. And why would they do it? They are not in the business of scooping unique IP -- they are in the business of understanding how AI is used across a variety of mundane, day to day work of individuals and companies. Useless math problem is good (or bad, as in this case) PR, but otherwise entirely worthless for the labs.
The model is theoretically FP8, but really internally its mostly FP4 already, so there won't be a cut-in-half-but-almost-just-as-good quant coming for this one.
Simple example. I am a CTO, and I want to upgrade our capabilities to perform automated pentesting. We see automated attacks of growing sophistication against our infra, and I want to be able to do the same to find vulnerabilities before the bad guys do. I asked GPT 5.6 Sol and Fable to give me a summary of options. No dice, in both cases I was told I need to be an accredited researcher to get anything. A fricking summary of commercially available options is getting censored. WTF.
I have opted out from data sharing, and when Claude asks me for feedback on a session it then asks if its OK to share that data with Anthropic.
I'd assume an opt out is an effective opt out. An opt out that is ignored by Anthropic is a breach of contract, not something they would do casually, esp. given the high turnaround and animosities between their own employees and ex-employees - and the labs. All it takes is one pissed off whistleblower to open a can of worms.
Occam's razor applies. The mathematician did not opt out from data sharing. OpenAI vacuums up all such data into training data sets. If OpenAI genuine does not easily know if a given session went into the actual training data set its probably due to the complexity of the data pipelines - not everything ends up impacting the model weights, after all.
"Please help save the coral reefs from extinction"
...thinking... ...thinking some more with xhigh effort...
BOOM.
(And if memory serves, there is also the opt out from training on consumer subscriptions). Its not plagiarism if you make your data available for the purpose of training their LLMs. It is you giving away your IP for some tokens.
The models are already here, and one can rent a GPU cluster to run such workloads at speed - no need to play with slow local machines. I'd assume one can host the thinking at an unsuspected public cloud provider, proxy the network traffic to some botnet to evade blocking - and the only thing remaining is time and cost.
I do wonder what tools exist for boring, legitimate companies to try and do the same to their own systems to find the vulnerabilities before the bad guys do. The paradox here is I can't run a de-restricted chinese model with the same tools that hackers are using - but I think enterprises actually HAVE to do it in order to stand a chance in preparing for the onslaught.
Though I'd admit that using claude for a few hours every day this year desensitivized me to its prose :-)
I am already receiving notices from some EU countries that they will want sit downs on how we use AI, and apparently they have the right to demand access to detailed designs and source codes. Fine, whatever, a waste of time, but why would anyone start an AI company here, knowing that there will be bureaucrats focused on making that startup's life harder? Considering AI talent is mobile I'd think a lot of such talent will just hop on a plane and have their startup somewhere less overregulated.
And I doubt finding that bug cost more than $1k or so. Even if $10k. Thats nothing for a large department in a multinational company. Thats maybe 2 weeks of fully loaded costs of an engineer. Thats a single business trip across the Atlantic. Thats about two company issued macbooks, or one, if the company is nice. Nope. Not budget.
And there is a bug to this bug, if the downgrade happens at close to full context window, there is no taking over this session with Opus -- happened to me twice: it throws some context window exceeded error, suggesting what fits in Fable context, may not fit in Opus's around the maximum. And then and there, an entire session is lost. In fact, there are two bugs, as /resuming such broken session attempts to resume with Fable, burning through tokens.
Oh well, I learned to be careful with the jokes around Fable.
We'd need quite some changes in the EU to focus on actually winning at something again. Winning at the expense of some of the lofty ideals. I'd rather EU have a decent frontier model lab that plays to win, and steps on toes while doing so, than have a very elaborate bureaucracy that tries to prevent that from happening. Its no surprise the bureaucrats have the exactly opposite goals, and its sad that most of the population won't see the consequences of this conflict of interest until it's too late to do anything -- because the Americans and the Chinese have near AGI capabilities, plentiful energy sources, and, really, not a lot of reasons to remember where Europe is on the map.
The worst part is, those people can't be voted out. Because of how EU works, the bureaucrats have an upper hand over the elected officials, and because of lavish compensation for the said elected officials, mostly bad people get elected anyway - those whos domestic careers have ended, or those whose parties want out of active politics, and somewhere "safe" where they can earn good money without causing any trouble. Thats a horrible system.
Claude building stuff means a lot of things that everybody wanted to do, just couldn't allocate the attention or other resources - now get built.
...and it characteristic the level of patronising arrogance in the issue thread
"This is normal. It is not recommended to copy passwords to the clipboard in any case, this mitigates this behavior and complies with new Web Authentication standards."
This does not even invite a discussion. Maybe some people run tight, safe systems and know what they are doing? Maybe some people never rely on a single password being the only thing between them an an account compromise? Nope. Some patronising guy knows it all, and will override what people want to do on their machines.