The content on that page is too AI-generated to make sense to me; I don't understand what the model is for.
I get that it’s designed to run on a CPU, big GPU or MacBook (although the way that was phrased confused me at first).
I’m struggling with what a “decoder-only” model is good for.