Uh, a hypothetical fully open source model would have the exact same problem, because LLMs rely on emergent phenomena and no one understands why they work.
6,363 karma · joined February 4, 2009
Uh, a hypothetical fully open source model would have the exact same problem, because LLMs rely on emergent phenomena and no one understands why they work.
But I do have a problem generally with attempts to impose language changes on others (in the case of this post you only see that tendency in the title).
This sort of linguistic prescriptivism seems in vogue for political reasons lately, most saliently in the hordes of people who insist that you must not use natural anthropomorphic language when talking about LLMs, but that’s far from the only political attempt to control language we’ve seen recently. Let people talk how they want! Langauage is an evolving thing that shouldn’t be controlled by scolds!
2. What’s your point? People are demanding justice for behavior they don’t like but isn’t illegal? The way to fix that is to gather a majority and change the law.
My company uses Claude models exclusively via Azure and AWS bedrock, which have their own licensed copies of the weights.
If all these people are so convinced Anthropic is nerfing models, have they tried other inference providers? Do they think the nerfing is coordinated across independent providers? Why wouldn’t any of these nerf-benches use these comparison points or even talk about them?
I think the most likely conclusion by far is that this is a psychological phenomenon.
I thought we were supposed to be hackers. Information wants to be free and all that. What a bunch of hypocrites, willing to betray their ideals as soon as it’s convenient.
Edit: removed a comment that was uncharitable and rude, for which I apologize.
https://www.nytimes.com/2026/01/05/business/media/corporatio...
You can try to language-police all you want, that doesn’t change the fact that the best way to describe the reality of the effects that LLMs have on the real world is to use language that analogizes to human concepts.
https://www.legislation.gov.uk/ukpga/1990/18/section/3 (1b.)
https://www.legislation.gov.uk/ukpga/1990/18/section/1 (1c.)
I’m told that the UK is a relatively authoritarian country where citizens have no real rights, so perhaps it can be charged anyway, but the plain language of the statute would seem to bar it.
Could you explain what your legal strategy would be to overcome the intent requirement of the CFAA? If openAI didn’t intend to hack anything and agents can’t intend to do anything at all, and the CFAA doesn’t permit negligence to stand in for intent, seems to me like the existing law does not cover the situation everyone keeps saying it does.
I am not a lawyer, but I seriously doubt the feds could win a CFAA conviction on the Hugging Face fact pattern, even if they wanted to charge it.
CFAA has specific intent requirements, and unlike some laws, negligence does not suffice. The agents can not have legally cognizable intent and it’s unlikely there’s anyone at OpenAI who intended for the hacking to happen (if there was, the case is easy).
Existing laws don’t contemplate AI agents that have independent goals. We need new ones, the existing laws are not remotely sufficient.
Also, were you trying out some new vocabulary? enculturate is not appropriate in the context you used it, and it’s not clear what exactly you were trying to convey, other than your own grumpiness, which came through loud and clear.
> He also had a very large family despite his protests about overpopulation.
As far as I can tell this is false. He had one daughter and then immediately and publicly had a vasectomy.I’ll always pay more to see fewer ads. My kids see far, far, far fewer ads than I and my peers did growing up watching linear TV in the 90s and I’m going to keep it that way. If Disney+ gets in the way of that I’ll stop paying them and stop using their service, easy as that.
I’m all for consumer awareness but I’m begging everyone to stop freaking out over prosaic non-issues like this.
All that is to say, being able to build something is not not not the same thing as understanding it.
We know lots about human development and genetics and biology and evolution and neuroscience and the physics of how brains are connected and send signals and how generally they are put together and have names for their parts and all that, but we’re clueless when it comes to “the hard question” of how qualia and consciousness emerges from that.
The scenario with the spooky simulation of thinking that emerges from LLMs is in the same category, with different details. Lots of knowledge about the substrate of the phenomenon, little to none about the much bigger question of how we get the appearance of cognition from these trained artifacts.
Clearly we understand extremely well how LLMs are created mechanically. We invented them and are currently putting massive amounts of work into studying and improving them. But that work is perforce largely empirical; figuring out the why once again eludes us. It just goes to show how mysterious the underlying phenomenon of cognition is.
Me: it’s disturbing we don’t know why this pile of numbers we made seems to *think* in a way previously only done by humans. I think it’s important that we understand this better if possible.
You: we don’t really need to know why that happens.
We don’t? I sure would like to know!So I don’t think “labs worked hard” is the same thing is “we know scientifically how these things work in any real level of detail”. The ability to build a thing, even if building it is hard, is not the same thing as understanding of what the thing is or how it works, not even a little bit.