Dario has stated multiple times he doesn't believe there is any value in open-weight models. Not surprised. This is not the behavior of an innovative company - it is fear-driven. They are seeing a rapidly shrinking moat.
It’ll be interesting to see if companies get tricked. I think it’s inevitable that it goes like MySQL/Postgres, where the open tools gets way better
If distillation wasn't a thing, they would certainly exist, they would have trained them from scratch or via a decent base models to remain economically viable.
What's for sure is that Claude wouldn't exist if it wasn't for data stolen from millions of creators. As they found themselves admittedly guilty of.
At not a single point in history did Llama ever achieve comparable real-world performance to frontier models. I was around. At best they were earlier at benchmaxxing than the others.
Nowadays the harness matters more than the model itself. For example pi.dev + GPT5-codex is a lot smarter than plain codex cli
They aren't. Any difference is in sampling parameters and post-training flavor choices. These aren't things that are "materially ahead", that's basically just LLM themes.
Listen, I want more open weight models in the world. They create entrepreneurial opportunities and support use cases which the foundation labs don’t want to support.
But open weight models are consistently three to six months behind on performance compared to closed models, as confirmed by both benchmarks and personal use. They’re closer on coding and much further away on non-coding tasks.
There are theories as to why these models lag, which I won’t get into. But anyone claiming open-weight models are close to closed-weight models is ignoring significant evidence to the contrary.
Please so demonstrate?
If I can do this, then a company that wants to sell local models seriously could do it too.
Wow, that's amazing! Care to share the changes? Would love to try them out.
What's amazing is that LLM technologies are so immature that even basic engineering diligence isn't being done. (Like detecting token loops, for example.)
Yeah, like I said - it's just a post-training difference. That's not a material difference, that's a difference of chrome and polish.
In 6 months, people won't work anymore. They will all use my products, outsource the thinking, why bother.
Oh and open weight models have no value...
There is a paper out there showing 30% of CEOs/C-suite have some psychopath tendencies. Not sure if they even used the term narcissistic , but I would add delusional.