Kyutai AI research lab with a $330M budget that will make everything open source
techcrunch.com
techcrunch.com
gifski [0] for example is a successful open-source project doing that.
* https://github.com/ImageOptim/gifski
And this is why open source means source available, look at the license. There are infinite variations between free software and classic source available.
This train has passed. Sort of like crypto/crypto. Open source functionally means source available; the rigid definition remains free software.
yes, I want FOSS too
The definition and history of the term as a licence is unambiguous in that the only restriction on redistribution is that it contains the source code under the same licence. There are senior engineers alive today that weren't even born when this was the commonly understood meaning of the term, it's not a new concept.
The term and usage is being co-opted these days but that's bound to happen when it's not a legally protected definition. Give it another 10-20 years and I'm sure we'll be having the same argument over whatever term ends up replacing 'open source'.
Language exists to convey a shared concept
In this case, the evolved version of open source fails to convey a shared concept in comparison to the prior term, “free and open source software” or FOSS for a shorthand adjective
Here, people with knowledge of the lexicon are using it accurately, and people without knowledge of the lexicon or its etymology are complaining when they should be pushing for FOSS instead of getting surprised everytime
We can't all be like Donald Knuth or Simon Tatham making TeX and PuTTY as personal projects.
[0] specifically the freedom to fork, to develop further, and to make new releases that others can also build upon, which means I aver that many of the public AI models are sufficiently open that they're de facto open source even if the licensing isn't there.
Even if it's a de jure violation of the copyright to make a derivative, I'm not sure you could prove that had happened when all the weights are floating point numbers you can randomise slightly as a first step — if training just happens to move them back to the original values, well, that's just evidence the optimiser was working.
You must mean should be, since we have decades of evidence to the contrary.
Lots of neural nets are pretty standard, and work by multiplying lots of numbers by other ones. The key is to figure out which numbers to use. Those are the weights of each connection between the artificial neurons in the model.
With them you can run the model yourself.
Spanish speakers also make this mistake. I haven't met German speakers, but they also say the equivalent of "is (adjective) since (time)" in German. It makes me wonder if English is just unusually strict about this distinction compared to other European languages.
This is an international forum, we're well accustomed to being able to parse meaning despite a few inconsequential grammatical issues.
If someone was to be really odious and hateful, the presence of that sort of thing could be harmful, but this seems like a polite correction of a common problem. And it is an international forum, there are plenty of people who might get something from language-chat.
Finally it was able to give me the Spanish "Él hizo esto" vs "Él ha hecho esto," but admitted that whether one used one vs the other was quite regional.
In Spanish, they do make a distinction in neutral speech, but it's not uncommon for someone to only ever use one or the other depending on the region they're from. The auxiliary verb form ("haber hecho" / "to have done") is more common in Spain than Latin America. Though, I don't know how much we should go into this; I feel like we've kind of derailed from the original topic.
Edit: is that correct or is there an apostrophe Im missing? It would better if you were française, n'est-ce pas?
EU is starting a program where AI startups will get access to their supercomputers and also get a chance to win prizes.
16 November 2023: Commission opens access to EU supercomputers to speed up artificial intelligence development [0]
- Launch of the Large AI grand challenge: This competition – launched today, is a collaboration led by the EU funded project AI-BOOST, with access to the European Supercomputers being facilitated by the EuroHPC JU. It encourages the wide participation from European start-ups with experience in large-scale AI models. The winners are expected to release the developed models under an open-source license for non-commercial use, or through publishing their research findings. The challenge will select up to four promising European AI start-ups that will be given access to EuroHPC supercomputing facilities to foster the development of large-scale AI models in Europe and a €1 million prize will be distributed among the winners.
- Opening up European supercomputer capacity: Access will be established for ethical and responsible AI start-ups, enabling them to efficiently train their models using European supercomputers.
- Enhanced activities and services: the EuroHPC JU will advance activities and services powered by High-Performance Computing to foster trustworthy AI in Europe. These efforts will aim to facilitate increased accessibility for AI communities and promote the optimal and efficient use of HPC technologies for scientific and industrial innovation.
[0] https://ec.europa.eu/commission/presscorner/detail/en/ip_23_...
Makes no sense. That money will go to waste.
Starting and scaling a business in Europe is harder than in America. This is true for fundamental reasons, like language and national borders. It’s also true due to regulation and the culture of work and towards commerce in general.
Some of those come with reasonable tradeoffs, e.g. in respect of employee protections. Many do not, particularly when it comes to licensing, bureaucracy and the peculiar way most European tax law and regulation tries to compensate for its licensing and bureaucracy by adding more bureaucracy in front of a balancing subsidy.
Yes, it's a big annoying to start a company in some EU countries. No, it's not as bad as HN claims.
Small companies can get away with it for awhile, but not forever
[0]: https://www.scaleway.com/en/news/scaleway-releases-the-detai...
Open source is already quite near GPT-3.5; it's reaching GPT-4 level that is the challenge.
what do you mean by 'corpus'? It is only 13GB so questions that require recalling specific facts aren't going to work well with so little room for 'compression', but asking mistral to write emails or perform style revisions works quite well for me
We can only hope.
"Co-founded by the Iliad group...To do this, the laboratory will use the computing power made available to it by Scaleway, an iliad Group subsidiary. Scaleway’s supercomputer has the highest-performance computing power for AI applications deployed to date in Europe."
> the answer is called Kyutai (pronounced "Cute AI" and meaning "sphere" in Japanese),