No PoE :(
583 karma · joined July 4, 2014
I think this should desactivate the moral high ground from which Anthropic is trying to speak. That they would want to make distillation orderly IMHO is fair, but to make it illegal is very rich from any AI frontier lab, really.
On the one hand I would have expected a completely new model, on the other hand it's an RL-ed K3 go Fable 5 capabilities, which demonstrate that this is probably possible, which is nice.
They just need this revenue by tv to be higher than the price of the mobile plan per tv. For a few Gb per month it may be relevant in the not so distant future.
Apple is fine-tunning Gemini to customize Siri for their customers. They improve what's between the model and their customers : fine tune, inference up to the product. This is exactly what Mistral is doing, with an even more diversity of usage and needs because they are business oriented, instead of customer oriented. This is also what make them economically very efficient in comparison.
Beside Apple is still doing science experiments while Mistral is capable of releasing commercial models, albeit small and specialized.
Don't get me wrong, it's absolutely obvious that Apple is incredibly powerful, now more than ever. But the way they see the future, Mistral have a leaner trajectory.
The two companies have read the market the same.
It's always very dangerous for first movers and their investors, and the commodification of intelligence seems even more likely each time a chinese open model release. It's less exciting to do business that way, but if you're building to stand the test of time, it's wiser that way.
You have to make at least 2 takeout to be sure to have all your files in good shape.
The problem is notto download but to verify and be sure nothing else is missing.
> The current free API tier will remain available to you until August 17, 2026. On that date, your account will be transitioned to the new free credit-based experience. You’ll be required to add a payment method to unlock $5 in free credits to continue to use the service.
Would have been interesting to test against the Big five instead !
[1] https://www.psychologytoday.com/us/blog/give-and-take/201309...
[2] https://web.archive.org/web/20061206025148/http://www.indian...
[3] https://journals.sagepub.com/doi/10.1177/014920639602200103
[4] https://aps.onlinelibrary.wiley.com/doi/10.1111/j.1742-9544....
[5] https://www.vox.com/2014/7/15/5881947/myers-briggs-personali...
Running AI models on local hardware was exploratory at first, and if it's so easy today it's thanks to open source. It's a little bit coincidental that we have this today, and that mainstream hardware have this capability. The fact that a phone can run very small models is exploratory or some kind of marketing opportunity at best.
Why would hardware company ships cards with more AI capabilites (like more VRAM) in the foreseable future ? On what ground does the marketing for on device AI will keep generating interest ? For something as important, it's very uncertain. But above all, it should not depends on these brittle justifications.
Showing good will in distribution and research prowess today is positive communication, but it can be exactly the oppositite if/when an attack using those small models will reach a high value target.
For China the cultural difference is so huge, it's difficult to say. I would think they first and foremost need to show to evryone inside and outside of China that they match american models. Second, i would say that when americans prefer few very powerfull companies on the get go because they can leverage a lot of capital rapidly to industrialize, China will prefer leveraging a lot of smaller companies exploring a lot of things simultanously (so doing a lot of research), THEN creating legislation to let only the best (or a few) to survive effectively. In the end it's the same result (monopoly or oligopoly), but China may have a stronger core (research) and America may have stronger productive capital, that may be proved obsolete... In the long run, in either side it's a gamble, again.
The dependency we have with anthropic and openai for coding for instance is insane. Most accept it because either they don't care, or they just hope chinese will never stop open weights. The business model of open weights is very new, include some power play between countries and labs, and move an absurd amount of money without any concrete oversight from most people.
It's a very dangerous gamble. Today incredible value is available for nearly everyone. But it may stop without any warning, for reason outside our control.