$330M is like 33 training runs of a large LLM. Not sure that would bring open source anywhere near GPT-3.5.
Edit: is that correct or is there an apostrophe Im missing? It would better if you were française, n'est-ce pas?
Spanish speakers also make this mistake. I haven't met German speakers, but they also say the equivalent of "is (adjective) since (time)" in German. It makes me wonder if English is just unusually strict about this distinction compared to other European languages.
This is an international forum, we're well accustomed to being able to parse meaning despite a few inconsequential grammatical issues.
If someone was to be really odious and hateful, the presence of that sort of thing could be harmful, but this seems like a polite correction of a common problem. And it is an international forum, there are plenty of people who might get something from language-chat.
Finally it was able to give me the Spanish "Él hizo esto" vs "Él ha hecho esto," but admitted that whether one used one vs the other was quite regional.
In Spanish, they do make a distinction in neutral speech, but it's not uncommon for someone to only ever use one or the other depending on the region they're from. The auxiliary verb form ("haber hecho" / "to have done") is more common in Spain than Latin America. Though, I don't know how much we should go into this; I feel like we've kind of derailed from the original topic.
EU is starting a program where AI startups will get access to their supercomputers and also get a chance to win prizes.
16 November 2023: Commission opens access to EU supercomputers to speed up artificial intelligence development [0]
- Launch of the Large AI grand challenge: This competition – launched today, is a collaboration led by the EU funded project AI-BOOST, with access to the European Supercomputers being facilitated by the EuroHPC JU. It encourages the wide participation from European start-ups with experience in large-scale AI models. The winners are expected to release the developed models under an open-source license for non-commercial use, or through publishing their research findings. The challenge will select up to four promising European AI start-ups that will be given access to EuroHPC supercomputing facilities to foster the development of large-scale AI models in Europe and a €1 million prize will be distributed among the winners.
- Opening up European supercomputer capacity: Access will be established for ethical and responsible AI start-ups, enabling them to efficiently train their models using European supercomputers.
- Enhanced activities and services: the EuroHPC JU will advance activities and services powered by High-Performance Computing to foster trustworthy AI in Europe. These efforts will aim to facilitate increased accessibility for AI communities and promote the optimal and efficient use of HPC technologies for scientific and industrial innovation.
[0] https://ec.europa.eu/commission/presscorner/detail/en/ip_23_...
Makes no sense. That money will go to waste.
Starting and scaling a business in Europe is harder than in America. This is true for fundamental reasons, like language and national borders. It’s also true due to regulation and the culture of work and towards commerce in general.
Some of those come with reasonable tradeoffs, e.g. in respect of employee protections. Many do not, particularly when it comes to licensing, bureaucracy and the peculiar way most European tax law and regulation tries to compensate for its licensing and bureaucracy by adding more bureaucracy in front of a balancing subsidy.
Yes, it's a big annoying to start a company in some EU countries. No, it's not as bad as HN claims.
Small companies can get away with it for awhile, but not forever
[0]: https://www.scaleway.com/en/news/scaleway-releases-the-detai...
Open source is already quite near GPT-3.5; it's reaching GPT-4 level that is the challenge.
what do you mean by 'corpus'? It is only 13GB so questions that require recalling specific facts aren't going to work well with so little room for 'compression', but asking mistral to write emails or perform style revisions works quite well for me
We can only hope.
"Co-founded by the Iliad group...To do this, the laboratory will use the computing power made available to it by Scaleway, an iliad Group subsidiary. Scaleway’s supercomputer has the highest-performance computing power for AI applications deployed to date in Europe."