Hacker News Reader

We still have to wait for actual cost of generated tokens to be revealed.

Economics depend on that a lot.

You can get a decent idea running some of this stuff locally. Depending on how efficient you want your agent to be, you can get an awful lot done on beefy local hardware and ~300W power consumption. Just inference of course ...

That would be like saying the first vehicle off the assembly line had to be profitable; there is an ocean of optimization that will drive the economics.

feels like pure copium to believe that won't change rapidly.

Belief without evidence is faith. I’m “agnostic” here.

I have no data for neither, so I’ll wait for numbers.

Will LLMs stay being useful? Definitely. Will in 10 years touching/changing code be somewhat niche, like ASM development is now? Not clear yet.

And optimisations are not a given, a lot of low hanging fruit are already taken, because it actually saves lots of money already now.

Reply on news.ycombinator.com