Hacker News Reader

>Would probably make sense to self-host Clef

For privacy perhaps but on pricing you're unlikely to come out ahead versus datacentres with scale and industrial power pricing

Because Clef is a larger model, larger context, can process images. Plus its open weights, so you can run it yourself.

Since it benches better than Jev, Jev is probably smaller and easier to host. They could also be losing a lot of money.

> no output price listed

It's weird to think of these kinds of models as having "output tokens". Cross-encoder approaches like Laya add a [MASK] marker per option, but nothing is generated the way an autoregressive transformer generates. It's one bidirectional pass over your input, then a small head scores each option, so you wouldn't really pay for output as much as only input

Output for decisions have so few output items (not really tokens here) that they are negligible anyway. Jev hyping "free output" is almost lying by omission.

framing it as "free output" is a decision /s