Hacker News Reader

Until you realize that ChatGPT is also fluent in 20 other languages by including minimal data into the training dataset.

View on HN

Minimal as in the amount a person needs to learn the language or minimal as in tiny if compared to English in common crawl but still orders of magnitude more than a person goes through for infancy language acquisition?

I think you know the difference.

It’s anecdotal, but here [1] is an example of AI learning to translate a new language faster than a human could learn to do it, from a similar amount of data, using Claude 3 Opus.

Translating a language isn’t quite the same as understanding it, but this is still impressively data-efficient.

[1] https://twitter.com/hahahahohohe/status/1765088860592394250

Did you read the "added context"?

"The author has later responded and apologized a flawed / biased methodology which led them to believe that Opus has no prior knowledge of Circassian (i.e. wasn't trained on it)

Apparently it was, and is able to speak Circassian just not perfectly"

I didn't see that! Thanks!

Reply on news.ycombinator.com