Hacker News Reader

> Now, software is cheaper and so people who couldn't afford to answer questions they've long wondered about can afford to answer them.

Temporarily. Token price will rise sharply when the bills finally come due.

View on HN

No longer convinced that’s true. Some of the indebted providers might go under but there is nothing preventing someone from just setting up a new provider and serving tokens debt free. GLM or whatever.

That provides continuous downward pressure on token prices even if it isn’t Astra level

Agree model providers can't take much margin, a few percent plus maybe a bit extra from those willing to pay for a "better" model. Upstream is more concentrated: TSMC, NVIDIA, AMD could maybe raise prices and capture more of the value, which would affect open model providers.

Do you have any evidence to suggest that this true? And if so, why can't I just use any of the very good open source Chinese models (and eventually American once reflection, thinking machines, etc catch up).

Exactly. You can buy on server grade mobo and CPU, stock it with ddr4 and run qwen and basically get gpt 3+ level quality now. A year from now, I imagine we'll see even better efficiency.

Look around? It's rape and pillage time for corporations.

Reply on news.ycombinator.com