Hacker News Reader

Ollaya (https://ollaya.dev) aspires to be Ollama for decision models. It can run Clef Flash, Laya, and other models. I've used it for local testing.

You can list the decision models available on OpenRouter: https://openrouter.ai/models?output_modalities=decisions. There are currently nine.

My AI harness uses Jev or a compatible model to approve shell commands that look safe without asking the user. (This is one security layer.) A quick benchmark (https://github.com/dbohdan/strument/tree/c2320ca142f77495ecd...) has shown that of five models on OpenRouter only Liquid D1 performs similar to Jev for this.

https://github.com/NandhaKishorM/laya

Thanks for the tip! Set it up locally and it works!

We got you.

At0M: A 60M local Jev at 16 ms latency and 79% accuracy on Typed Decision

https://at0m.pienomial.com/ https://news.ycombinator.com/item?id=49920350

Jumping on this, what about on-device?

I'd love an privacy first on-device model i could use in iOS.

We got you. How would you use it though ? Through Apps ? Would love to discuss.

At0M: A 60M local Jev at 16 ms latency and 79% accuracy on Typed Decision

https://at0m.pienomial.com/ https://news.ycombinator.com/item?id=49920350