Hacker News Reader

Comment by enlyth | Hacker News Reader

A lot of people seem to be overlooking the fact that it's missing a huge piece of the puzzle, and that is being able to learn.

This is a model frozen in time, you can explain to it a hundred times why it's wrong and it will learn nothing. Until we have something that learns continuously from more input, I am not impressed

View on HN

It is only a limitation of the interface that we're interacting with. There is no reason it couldn't backpropagate towards a better solution when told that it's wrong. OpenAI probably aren't letting it train online lest some jokers try to teach it racism and other bullshit etc.

> There is no reason it couldn't backpropagate towards a better solution when told that it's wrong.

That is a lot of handwaving/massive oversimplification - there are a number of reasons this is infeasible (one already mentioned) It matters because a lot of the AI hype these days relies in part on people’s misunderstanding of this.

however once it does have the ability to learn from its mistakes, document its millions of simultaneous chats and has the ability to call on the software tools we use its pretty much going to be unstoppable.

Kinda looking forward to the next few years.

Yes, this is an attempt to teach ChatGPT how to Rot13 and demonstrates that this isn't possible. The model doesn't learn. It can extend an input to produce a longer input, but its memory is limited. It can find the exact definition of Rot13 because that was in its training data, but it can't apply that definition.

Reply on news.ycombinator.com