Hacker News Reader

Comment by vikramkr | Hacker News Reader

I don't think it's obvious that any of these model providers are even profitable right now. I'm also not sure what there is to "figure out" - it's an expensive technology where the cost scales per token, so they charge per token? would you rather they burned even more money giving it away for free until everyone was dependent on it and then hyper enshittified to try and not go broke like so much of the rest of tech?

View on HN

My point, poorly made, was that I can run it myself for “free” without caring about tokens at all. Tokens are an artificial construct.

So by that logic all VPS providers are just a money grab because you can run your software yourself for “free” without having to pay for that artificial construct these greedy people call “compute?”

I don’t understand your point. You’re using a resource. You’re wasting time on the GPU of someone else. That chunk is called a token. And that’s what you’re being billed.

VPS providers don’t put out articles espousing their value twice a week because they don’t need to, the value is obvious.

I didn’t mean to come off as argumentative. Again, in my head it’s so obvious what the end game is, and it isn’t to better humanity.

That's not remotely correct- how would you be able to ignore tokens? That's literally what defines the context size of an llm, the larger the more memory. Generating each token is literally the compute you're doing. Your hardware limits how many tokens per second you can produce with a particular model. It's literally what you're consuming electricity to produce. That's like saying you can drive your own car for free without worrying about how many miles you've driven.

Reply on news.ycombinator.com