I am not sure about this, but after playing with chatGPT I can clearly see what he means by lack of 'understanding'. There is absolutely ZERO real understanding.... only correlations and probabilities of words....
Penrose is one of those people who is "religiously" against AI. He will clutch at any straw possible to argue that AI will never be conscious, or understand anything, or encroach on our human uniqueness and/or spirituality in any way. His favorite argument seems to be that our brain is utilizing (inherently non-computable - at least by non-quantum computer) quantum effects in the brain's microtubules, but I'm sure if it wasn't that it'd be something else. He doesn't WANT to believe, therefore he finds an excuse not to believe.
Tacking “artificial” on top of that doesn’t make it any clearer.
My understanding of the taxonomy of these things within CS is that AI is a broad class of techniques for problem solving. Machine learning is a subset of those techniques which uses data and statistical methods. Non-ML AI is sometimes called GOFAI (“good old-fashioned AI”).
Machine Learning (ML) is a catch-all term (not in of itself a technology) for any approach where systems are designed to learn from data. This includes techniques such as random forests and SVMs, as well as neural nets.
There's really no fundamental relationship between AI and ML. Neither one is a subset of the other as this is an apples and oranges comparison - one is a goal, and the other is an approach). That said, all recent progress towards AI has been achieved by using ML, although not all uses of ML can really be regarded as AI.
Hope that helps define terms.
Further, the canonical Russell and Norvig AI textbook [2] only mentions machine learning briefly, as one of several skills that a computer would need in order to pass the Turing Test:
> machine learning to adapt to new circumstances and to draw new conclusions
And the Wikipedia page (which also contains a similar nested diagram) describes ML as a “part of” artificial intelligence.
So it is pretty clear to me that ML is treated as a sub-field of AI. However I still believe the AI field dances around the definition of Intelligence, preferring a practical task-oriented definition instead.
[1] https://www.edureka.co/blog/ai-vs-machine-learning-vs-deep-l...
[2] https://www.amazon.com/Artificial-Intelligence-Approach-Stua...
> As of 2020, many sources continue to assert that ML remains a subfield of AI.[29][30][27] Others have the view that not all ML is part of AI, but only an 'intelligent subset' of ML should be considered AI.[5][31][32]
I'm well aware that there are some people who regard anything ML-related to be AI, which is the sensationalist view taken by the popular press who want to write stories about AI, but that doesn't mean it's true. What does something like a SVM classifier have to do with AI - it's more like a line fitting technique. Or what about a neural net that classifies photos as cat vs dog - seems better described as image recognition than AI (and the whole post-AlexNet modern neural net revolution was born out of the 2012 ImageNet image recognition competition). Or how about an echo-cancelling circuit in a telephone - is that AI to you? Why not - it's based on machine learning ...
As for ChatGPT, technically it's a language model, so really part of NLP - linguistics research. All it does it try to predict the next word in a word sequence. Of course it therefore ends up regurgitating lots of intelligent stuff it was trained on (as well as dumb and false stuff it was trained on), but that doesn't make it intelligent. Similarly, we don't say Google is AI just because it responds to search queries by finding web pages with intelligent content.
I think the distinction is important because I suspect it explains why ChatGPT succeeds at certain tasks when previous LM-only models failed miserably.
I'd describe it still a language model, but just one with "filtered" output.
I'm not sure if ChatGPT has been documented/described, but it's very similar to OpenAI's InstructGPT which they have described, and which they still refer to as a language model.
> We’ve trained language models that are much better at following user intentions than GPT-3 while also making them more truthful and less toxic, using techniques developed through our alignment research. These InstructGPT models, which are trained with humans in the loop, are now deployed as the default language models on our API.
And further, for any test we choose we must ask ourselves, “do we expect our ability to discriminate between these two classes, man and machine, to go to zero as machine performance continues to improve”
If we believe that only continued performance improvements are needed to make AI indistinguishable then that means today we’re only talking about differences in quality rather than differences in kind.
https://news.ycombinator.com/item?id=33833178
We're just at the beginning.
For example one of those top ten mathematical problems. Humans solved a few of those, lets challenge AI
I think it’s not a very good metric.
And yes, sadly, many humans are just probalility in my eyes.
Impressive that it does so in coherent English, but I'm not convinced it's in any danger of understanding firearms or fun beyond realising sentence forms those words would be a good fit and poor fit for.
I posted an excerpt from ChatGPT a couple of days ago where it stated - in an identical format to its previous two correct answers - that 355 was a prime number because it wasn't divisible 5, and that's the sort of problem that Turing machines are known to be able to completely and accurately model
> He argues that AI does in no way 'undestand' anything. He goes even further and uses Goedels Theorem to show that 'understanding' itself is non-computeable.
So how do brains understand things? Is he asserting that something is happening in the brain that can't be described/modelled computationally?
Example of a question a typical human idiot can solve without ever getting it wrong, but ChatGPT can't reliably: Is 7 dollars enough to buy a thing costing 7 dollars? ChatGPT can usually solve this, but it sometimes gets it wrong, getting that sort of thing wrong ever means that it doesn't understand, it just uses dumb statistics.
Edit: I'm not saying it is impossible to make AI models that understand these things, just that the ones we have today don't.
https://i.imgur.com/im9EquK.png
Perhaps it's magic trick that a language model can do math, but it's quite impressive that it gets very close to the desired answer.
Here's the thing though. Even on the current trajectory, we will produce programs that sure as hell APPEAR like they understand. This is really what Alan Turing was getting at when he said that the question of whether a machine can think is meaningless. It's like asking whether a submarine can swim. The fact is, dead machine or not, the outputs will increasingly exhibit, what look like, emergent properties of understanding, and even apparent sentience.
This to me is the truly stunning thing about ChatGPT. It might have limitations, but through mere statistics and 'auto complete on steroids' it can do way more than you'd think was possible with such an approach.
> Obviously I'm hand waving here as I'm out of my depth with this subject. My sense though is that there are things about the brain about its evolution that are eluding us, and which are significant.
Please go and deepen you meditations. First:
Get to the point, where you have stripped your awareness away from your sensory input (pratyahara)
(which everyone may know, it can be done, when you are deeply concentrated, someone may have said something to you, but you didn't "hear" it)
If you are at that point, your entire "experience" will consist of your "inner world" (thoughs and emotions). So next is to "concentrate" your mind (Dharana) by bringing it back to the same object (lets say a rose for example). This takes A LOT of practice but after the years, you mind will become clear and focused so that the time where only the object (the rose) is in your mind becomes longer and longer (a few seconds up to minutes).
As you practice further episodes of undisturbed, completely one-pointed mind become longer and longer and you enter into Dhyana (meditation). You are completely focused on the object, and the object itself is all that you experience. Imagine what that means: your entire experience constist of only the rose and nothing but the rose!!!
As this goes on and on for longer and longer periods of time, the yogis and mystics say that the boundaries between "you" the subject and "the rose" the object start to dissolve more and more, until they vanish. You are the rose and the rose is. Nothing but the rose that you are!! (They call it samadhi, the dissolution of individual existence and merging of object and subject).
This is just on an object but when the object is your awareness itself and this process happens, they call it many different names depending on tradition. ("Nirvikalpa Samadhi" in the yogic tradition, "Unio-Mystica" in the christian traditions, "fana" or "Baqaa billah" in the islamic mystical tradition. It is the realization of the unity of consciousness that is and that only is and that "I" merges into...
You're smarter than ChatGPT for a simple reason - you're not trapped in a computer and can decide what to spend time thinking about and where to go in real life to look up answers for your questions.
Roger Penrose is a historical hero of the physics community and a current embarrassment from time to time. His ideas on things like computation and neurobiology are not worth taking seriously.
It’s unfortunate to see people like the one you’re responding to using his Nobel Laureate credentials to justify his nonsense.