Hacker News Reader

yes, but at that point even open weight models are not free. Can someone set up the best open-weight model for free and charge pretty much just for GPU usage+operations+margin for inference? yes. But they would have to keep up with how good the private models are. The bet is private models would sell in a similar way at a premium and invest in staying ahead. Is this bet going to work? no idea, don't shoot the messenger.

View on HN

> yes, but at that point even open weight models are not free. Can someone set up the best open-weight model for free and charge pretty much just for GPU usage+operations+margin for inference? yes.

Or, the company itself can rent the GPU and host the model of their choice on it.

> But they would have to keep up with how good the private models are.

Why? The whole point of the thread is that the marginal gains of using private models is a fraction of the additional cost of using those private models.

IOW, if you really need that improvement over the open models, you can go ahead and pay it. What we are seeing though is that the improvement in general is barely noticeable but the cost is 4x as much.

Reply on news.ycombinator.com