Hacker News Reader

Comment by boredumb | Hacker News Reader

there are roughly three of them and they all use the same pricing model. I am also not in the position to build a frontier model company these days.

View on HN

You could try:

1. Self hosting

2. Chinese models

3. Running it locally. Requires upfront cost and compromises on TPS.

> I am also not in the position to build a frontier model company these days.

Well if you're not even going to put in the effort...

Wait. Let me do this for you.

     /config model=boredumb effort=xhigh

     /ultraplan "Build a frontier model that can run @1ktok/sec anywhere DOOM will run"

There are more than 3.

Hell, I use 3 different providers, and I currently don't give a dime to Anthropic or OpenAI.

A per-token model roughly aligns with the providers' costs, and it is an objective measure, so it seems a reasonable way to charge.

I see posts all the time on HN about which models from which providers offer the most bang-for-the-buck, and how to minimize token usage and still get optimal results, so it appears that competition is working.

Reply on news.ycombinator.com