Hacker News Reader

Comment by jakozaur | Hacker News Reader

The coding seems to be one of the strongest use cases for LLMs. Though currently they are eating too many tokens to be profitable. So perhaps these local models could offload some tasks to local computers.

E.g. Hybrid architecture. Local model gathers more data, runs tests, does simple fixes, but frequently asks the stronger model to do the real job.

Local model gathers data using tools and sends more data to the stronger model.

View on HN

Anyone know how long does the context last for running model locally vs running via OpenAPI or Cursor? My understanding is the model that run on the cloud have much greater context window that what we can have running locally.

I have always thought that if we can somehow get an AI which is insanely good at coding, so much so that It can improve itself, then through continuous improvements, they will get better models of everything else idk

Maybe you guys call it AGI, so anytime I see progress in coding, I think it goes just a tiny bit towards the right direction

Plus it also helps me as a coder to actually do some stuff just for the fun. Maybe coding is the only truly viable use of AI and all others are negligible increases.

There is so much polarization in the use of AI on coding but I just want to say this, it would be pretty ironic that an industry which automates others job is this time the first to get their job automated.

But I don't see that as an happening, far from it. But still each day something new, something better happens back to back. So yeah.

Optimistically, there's always more crap to get done.

I agree. It’s not improbable for there to be _more_ needs to meet in the future, in my opinion.

Not to open that can of worms, but in most definitions self-improvement is not an AGI requirement. That's already ASI territory (Super Intelligence). That's the proverbial skynet (pessimists) or singularity (optimists).

Hmm my bad. Maybe Yeah I always thought that it was the endgame of humanity but isn't AGI supposed to be that (the endgame)

What would AGI mean, solving some problem that it hasn't seen? or what exactly? I mean I think AGI is solved, no?

If not, I see people mentioning that horizon alpha is actually a gpt 5 model and its predicted to release on thursday on some betting market, so maybe that fits AGI definition?

Reply on news.ycombinator.com