Hacker News Reader

I would only start to entertain this when we had AI running for reasonably long period say a year with same full context. That is in same run over a year it had collected information. In singular session.

No point even considering it if it can't run for extended periods. And actually keeping learning during the duration. As surely person should stay alive for decades if allowed.

View on HN

An LLM that could mutate its own weights might be closer to it. The various labs must have experimented with this, but it seems that it would be economically prohibitive to productize.

That's my ignorant thesis since the launch of GPT 4. Everytime I mention it, someone says it is impossible. But most AI labs are working on big models that serves lots of people simultaneously so the shared context wouldn't make much sense. I think we will see more on this now that local models are gaining more traction and capturing the hype.

Reply on news.ycombinator.com