Viking 7B: open LLM for the Nordic languages trained on AMD GPUs
silo.ai
silo.ai
The correct use of those words demonstrates that you are either not an AI, all of them being trained on so much bad language, or are an AI from a more perfect future.
ETA: It is differentof course just perhaps not as much as people sometimes try to say. You can definitely ruffle some feathers with this one given the uniqueness of Finnish is pretty central to Finnish nationalism.
It basically sounds like the language a Finnish person that has lived their whole life in Norway, and then starts to mix words because they forgot the Finnish words.
But that's about it. I know there are some other dialects, too, but these are all very small-scale languages that are either extinct, or will be extinct in some decades.
Much easier for Finns to learn Swedish, that for Swedes to learn Finnish, IMO. I speak Norwegian and Finnish (lived in Finland when I was young)
Also, it's "laastari", not "laasteri", so uh.
“ Further emphasizing digital sovereignty, Viking is trained on the EuroHPC supercomputer LUMI, utilizing up to 4096 AMD MI-250X GPUs. LUMI is not only Europe’s most powerful supercomputer and the 5th most powerful in the world, but also the 3rd greenest supercomputer among the top 500 supercomputers. LUMI’s energy consumption is covered with power produced 100% with hydroelectricity, and the waste heat of LUMI will account for about 20 percent of the district heating in the surrounding city of Kajaani. ”
I hope to see this used to generate a customized curriculum for each neurodiverse child so that we can live in a more equitable society.
These architectures are less capable than brains in many ways. So, we should expect them to have such trade-offs. An efficient one should work fine on English, mathematical notation, and a programming language. Maybe samples of others that illustrate unique concepts. I’m also curious how many languages or concepts you can add to a given architecture before its effectiveness starts dropping.
Some kind of diminishing returns asymptote from text volume alone must have been hit a long time ago.
To be clear, LLMs are not capable of reasoning.
Is it reasonable to show interest in something you call uninteresting?
Was Gödel a reasonable man, starving to death in fear of being poisoned?
This is Hackernews, I would have expected data, not promises.
AMDs bad rep in AI is mostly due to flaky support of its consumer GPUs.
* cries in Faroese *
And how did they decide that, e.g., German or Dutch would make the model worse?
>Silo AI and TurkuNLP are dedicated to developing models that not only excel in linguistic performance and inclusivity but are also attuned to local values and cultures.
https://www.silo.ai/blog/viking-7b-the-first-open-llm-for-th...