Hacker News Reader

Comment by iameli | Hacker News Reader

I can't claim to understand everything my brain is doing, but accepting input and filtering it through a bunch of neuron chains to result in some kind of output sounds like "statistical analysis" to me.

You seem convinced that ChatGPT will never have "actual intelligence" — care to make a prediction about something that LLMs will never accomplish? We know they can write code, write essays, generate artwork, and play chess. What's a task that requires "actual intelligence"? Parenting a child? Running for President? Making a steak sandwich?

View on HN

An LLM will never be able to produce something that cannot be statistically derived from its training data.

So... creating a new language, maybe?

https://maximumeffort.substack.com/p/i-taught-chatgpt-to-inv...

My bet would be that in ten years GPT would get pretty good at it, but eh, I dunno.

I see what you are going with here for it not being able to come up with original things. But I think that falls apart when you realize almost nothing humans do is original, everything is just building on other things.

The vast majority of what people do is this, yes. Just like how most of the time, we're all running on autopilot and our behaviors are pretty much just following scripts. "Meat robots".

But it's not 100%.

ChatGPT's attempt: https://gist.github.com/iameli/d9a5b715ec9baa5b11063888e054d...

Are those two responses enough to say it's invented a language? Probably not. But it's already farther along than I would have gotten if you asked me to do such a thing.

If I kept prompting it for hours, I bet it would start to contradict itself and lose track of the rules it had already established, but so would I. If I were actually inventing a language, I'd take months and keep extensive cross-referenced documentation on grammar and syntax and vocabulary. We don't _let_ ChatGPT do that, it has no mechanism for persisting its ideas like that. But like... neither would I if you took away my notebook and the parts of my brain that persist long-term memory.

I guess my interpretation here - I see differences in _capabilities_, but not differences in actual _intelligence_.

Reply on news.ycombinator.com