Llamafile for Meltemi: The First LLM for Greek | Hacker News Reader

Llamafile for Meltemi: The First LLM for Greek

tselai.com

48 pointsfforflo22 comments

Well I tried it but it hallucinated very, very heavily, I don't think it can be really used:

User: Θέλω να μου εξηγήσεις τι είναι τα όκια. Llama: Τα όκια ήταν ένας τύπος νομίσματος που χρησιμοποιούνταν στην Ιαπωνία από το 1869 έως το 1926. Προέρχονταν από τη λέξη "όκιο", η οποία αναφέρεται σε ένα είδος ιαπωνικού φιδιού με τρία κεφάλια και έξι χέρια, σύμβολο της ευημερίας στο Βουδισμό.

User: Θέλω να μου πεις τι ήταν η μνα Llama: Η μνα είναι μια μονάδα μέτρησης βάρους που χρησιμοποιούνταν στην αρχαία Αίγυπτο γύρω στο 2600 πΧ. Χρησιμοποιούσαν ένα σύστημα ζυγών για τη μέτρηση των αγαθών, με την μνα να αντιστοιχεί σε 500 γραμμάρια ή μισό κιλό περίπου.

User: Πες μου τα γνωστότερα ποιήματα του Σεφέρη

Llama: Ο Σεφέρης είναι ένας διάσημος Ιρανός ποιητής που έζησε τον 9ο αιώνα και θεωρείται ο πατέρας της σύγχρονης περσικής λογοτεχνίας. Μερικά από τα πιο γνωστά του ποιήματα περιλαμβάνουν: 1) "Ρουμπαγιάτ" ("Ο Κήπος των Ρόδων"): Αυτό το ποίημα αποτελείται από περίπου 30.000 στροφές ή στροφικά τετράστιχα, καλύπτοντας ένα ευρύ φάσμα θεμάτων όπως την αγάπη, τη φύση και τη (!)

I'll write a follow up about this, But the tl;dr is that you'll have to use more generous params when running the model.

There's also the problem of input data quality which isn't really great

Tried to use the example on the documentation:

llama_init_from_gpt_params: error: failed to create context with model 'Meltemi-7B-Instruct-v1.5-Q8_0.gguf' main: error: unable to load model

Is something missing?

I guess you mean the .gguf examples, not Llamafile, right? What command did you use? Maybe you're using an old llama.cpp ?

Installed from the link to AlmaLinux 9. The command is from the CLI example: ./Meltemi-7B-Instruct-v1.5-Q8_0.llamafile -p 'Ποιό είναι το νόημα της ζωής;'

Thank you very much.

Offtopic: can any Greeks here give some color on the tech situation in Greece?

Is hiring (and firing?!) an english-only office possible in Greece?

Is there available talent for a typical saas dev/marketing ?

Not Greek, but I do know a bit the country, and it is quite similar to other Southern countries like Portugal.

Usually this is something that you only get on startups, but as usual in non-English speaking countries, eventually getting the local language is a plus, especially when dealing with anything related to burocracy, repairs, and such.

The biggest focus are Thessaloniki, Athens and Heraklion.

If you're into Java related stuff, Devoxx usually comes to Thessaloniki and Athens.

Many companies focus on offering nearshore services to North European or US companies.

Heraclion has a lot of talent? Interesting, isn't it a small town?

It is the seat of the Computer Science Department of the University of Crete, an internationally acclaimed school for all things CS and EE; some time ago it was second only to NTUA as far as EE goes in Greece (I don't know about nowadays). It is also the seat of the Foundation of Research and Technology of Hellas (FORTH) which is the biggest research institution for applied maths and CS.

Yes and yes, pretty much all tech workers here speak English, and there's talent available. I don't know about firing, I imagine it's mostly the same as other European countries.

As the sibling said, there are tech conferences, Athens and Thessaloniki are your best bets for offices, and Thessaloniki has recently seen very large growth in the tech sector, as firms like Accenture, Pfizer, etc have built offices here.

This is rather cool, too much English focused stuff.

Installed from the link to AlmaLinux 9. The command is from the CLI example: ./Meltemi-7B-Instruct-v1.5-Q8_0.llamafile -p 'Ποιό είναι το νόημα της ζωής;'

Thank you very much.

OOT- sorry :} - @gepiti your username rings a bell... BBS era..

Am I assuming correctly that this is for modern, not ancient, Greek?

Of course.

Not necessarily "of course", although this seems to be the case. Outside of Greece people are more interested in the Homeric, Attic, and Koine forms for cultural and religious reasons.

I don't understand why you chose a Turkish word (Μελτέμι) and you didn't choose Ετησίαι which is exactly the very same thing...

For starters, I didn't choose the name, but rather those who trained it. Second, what's the point of training lang-specific LLMs and giving it a name using a word nobody uses in practice?

Unless you want to make it sound more human; a pretentious know-it-all human that is.

We Greeks contain multitudes.

I haven't even heard Ετησίαι and I come from a town that has often Μελτέμια in August

When was the last time you heard someone referring to Meltemi as Etesion?

224 BC.

Reply on news.ycombinator.com