Hacker News Reader

Not sure I get it. The model you're improving is local? If so how do you even calculate cost compared to an API

Open source models.

wmo routes requests between frontier models and open source models that continuously train using Tinker. As the smaller models improve, more traffic gets routed to them.

Calculating cost is just tokens in/out.

What are the costs to train and use the Tinker models?

Expensive, in the thousands. We have our own infra in house and are working on bringing these costs down

But in the thousands can pencil out if you're saying tens of thousands over calling the frontier models, no?

Exactly

Reply on news.ycombinator.com