Richard Stallman's thoughts on ChatGPT, AI and their impact on humanity
reddit.com
reddit.com
It matters insofar as determining whether something is intelligent and/or sentient, which is critical to determining whether this "AI" should be conferred human rights or not.
I realize I'm being a bit facetious here... though as I write that, I'm not sure how accurate that is.
Eventually, after we move from "AI" where we are now to actual artificial intelligence, we'll have to figure out what rights should be conferred if any.
---
Pig eggs and chicken eggs differ fundamentally, as pig eggs are not laid by pigs, while chicken eggs are laid by chickens. Let's clarify the differences:
Chicken eggs: These eggs are laid by female chickens (hens) and are a common food source for humans. They have a hard, calcium-based shell and contain the yolk, egg white, and other nutrients needed for a developing embryo. Chicken eggs are typically eaten for their nutritional content and can be cooked in various ways, such as boiled, fried, or scrambled.
Pig eggs: Pigs, being mammals, do not lay eggs like birds do. Instead, they reproduce through internal fertilization, and their offspring develop inside the mother's womb. When referring to "pig eggs," it's likely in reference to pig oocytes or ovum, which are the female reproductive cells involved in mammalian reproduction. These cells are microscopic and not something that can be consumed like a chicken egg.
In summary, chicken eggs are laid by hens and commonly consumed as food, while pig eggs (or more accurately, pig oocytes) are the female reproductive cells involved in pig reproduction and are not something that can be eaten.
> There is no such thing as cow eggs. Cows do not lay eggs. Chickens lay eggs that are commonly consumed by humans. The main difference between chicken eggs and other types of eggs is the way the chicken has been raised, treated, and fed. Different farming practices can affect the nutritional content of eggs12.
My gut feeling is that global long term memory and what we call hallucinations right now might actually be the next step to get closer to general intelligence.
I’m not sure we have the right reinforcement models yet tho, as counter intuitive as it might sound I don’t think that a reinforcement model that is based on correctness only is what we need.
Humans make mistakes all the time, and we bullshit all the time. If anything I think that ChatGPT scares people not because it gets things right but because how confidently it gets things wrong which is something we do all the time.
Older “chat bots” and other NLP things like Watson seemed to be essentially glorified search engines they’ll either give you a correct answer or they won’t answer at all.
So they felt nothing more than a tool not unlike an encyclopedia. ChatGPT will produce an answer under most circumstances but it won’t be perfect and this is what people seem to anthropomorphize with the most.
“Old way: 2 hours to write code, 6 hours to debug code. New way: 5 minutes to tell chatgpt what to code, 24 hours to debug”
I doesn't seem implausible that some of the first civilians who were exposed to calculators could have been convinced that they were capable of intelligent thought.
And 60s/70s science fiction is full of stuff that they imagined computers would do. Like asking questions and receiving answers that require both inference of facts and deduction like "computer, tell me what happened to this planet".
Chatgpt is literally just a scaled up version of this. And there's been some kind of eternal September of people who don't understand how a computer works believing all sorts of stuff about it.
But are humans just slightly more advanced, chemical-based AI? I don't know. Certainly through the Internet, they seem like it. Go to Reddit and look at the comment section. Especially in political discussions. I'm not convinced the "humans" posting there are not just the dumb output of language models--certainly not much more advanced than ChatGPT. When you [think you] have an opinion about something, how do you know it's actually an original thought, and not just the algorithmic output of your brain's many years of "model training". The word I type next in this comment may, when you peel back all the superstition about "souls" and "free will", simply be my language model's nextWord() function. What is original art? If I paint a picture or compose music, it's not original. It's based on my many years of observing the world, looking at other art, listening to other music. What hubris to think that just because it leapt from human fingers onto a canvas that it's somehow imbued with originality!
Humans are pretty good at the next word prediction.
(that passage is from Why Your Brain Can Read Jumbled Letters - https://www.treehugger.com/why-your-brain-can-read-jumbled-l... )
From Your Brain Is a 'Prediction Machine': It Predicts What the Other Person Is Going to Say (2014) https://www.learning-mind.com/your-brain-is-a-prediction-mac...
> Until now scientists believed that our brain processes the stimuli received from the environment from the “bottom-up”, that is, when we hear someone speak, the auditory cortex of the brain processes the sound first and then activates other areas that are responsible for speech comprehension.
> However, more and more neuroscientists seem to support the theory that the brain ultimately analyzes the external stimuli from the “top-down”, which makes the brain a kind of “prediction machine”.
> As reported by U.S. researchers, our brain anticipates constantly in order to be able to respond lightning-fast and accurately to anything that is going to happen. For example, it is able to predict words and sounds from the context. From the phrase “grass is…” we can easily predict the continuation – it is probably the word “green”.
> > “Our findings show that the brain of both the speaker and the listener uses the process of language prediction. This results in similar brain patterns in both interlocutors,” said the study’s senior author Dr. Suzanne Dikker from the Department of Psychology, University of New York. “This happens even before the speaker utters the phrase he is thinking“.
https://www.amazon.com/Surfing-Uncertainty-Prediction-Action...
Popularized by Pink Floyd ( https://youtu.be/wbOTkDn49qI )
> For millions of years, mankind lived just like the animals. Then something happened which unleashed the power of our imagination. We learned to talk and we learned to listen. Speech has allowed the communication of ideas, enabling human beings to work together to build the impossible. Mankind's greatest achievements have come about by talking, and its greatest failures by not talking. It doesn't have to be like this. Our greatest hopes could become reality in the future. With the technology at our disposal, the possibilities are unbounded. All we need to do is make sure we keep talking.
(Original: https://youtu.be/du_iG7Veupc )
We can see with our own minds and that of animals that there is something greater that emerges with the additional size and complexity of the mind that wasn't there in simpler approaches.
Is not not unreasonable to consider that between Eliza and GPT-4 that something greater has emerged that is able to maintain a consistent world model rather than the just playing with words.
Weizenbaum took a "short cut" for the world model by going down the path of a Rogerian psychotherapy which allowed him to intentionally avoid the need for a world model in order to work with the words that are fed in.
GPT-3 and even more so, GPT-4 has a world model that it is able to work with and interact with.
If we are going to call GPT "just an advanced chat bot" then I would contend it is equally appropriate to call a human "just an advanced sea squirt."
No - we also don't. It depends on the context, and it depends on the stakes. Some contexts are more "bullshit" tolerant, others are critical.
Conversely to your statement, " """we""" do not condone the error of the politician, of the manager, of the doctor, of the lawyer, of the worker - and we want good warranties for any entity responsible - repeat, responsible".
Which, incidentally, is a reason why Decision Support Systems are Decision /Support/ Systems.
Unless you're using a definition of "understand" that implies conscience of self, I would argue that a calculator is a device that understands nothing except (a subset of) math. That's what makes a calculator reliable in ways that ChatGPT is not.
Philosophically speaking it could be argued that no software understands anything, but I think in the context of this discussion "understands" means "has a model of its context and the way one interacts with it", which is something a calculator (and plenty other software) definitely has and ChatGPT has not.
By itself it's unlikely to ever be knowledge of course.. i see it more akin to NLP than knowledge. Which is to say, a general purpose language parsing tool which we can hand the result to something else. A conversational API, if you will, but we'll still need layers to actually run logic. To know math if you will.
Disclaimer: I know very little on the subject. Pure speculation.
But, even if we drop that interesting edge case i suspect we can make something very useful with the primitive that LLMs offer.. in the calculator example. ChainLang and co seem a really interesting tool for LLMs.
(Assuming that this happens, of course. Diminishing returns could make scaling infeasible past some point, for instance.)
The LLM approach may not be able to replicate the "knowledge" your calculator has, but it (or some pre/postprocessor) may be able to recognize that a given question is actually something a calculator can answer concretely, and then it can delegate the computation to traditional software that really does "know" how to answer the question.
>Our brains have different processing centers.
Uhh, no they don't? Did you know everything you know now about math when you were born, and are you also incapable of learning new things about math? Because that's how the wolfram plug-in works.
The far more practical (profitable) outcome for what they currently built is to just make a useful tool, a "smarter" wolfram alpha, and that can be iterated upon by delegating relevant operations to specific techniques that are more applicable to the question at hand.
The map is still not the territory, sorry.
From https://en.wikipedia.org/wiki/Chinese_room#Complete_argument the conclusion of the complete argument is:
> (C1) Programs are neither constitutive of nor sufficient for minds.
> This should follow without controversy from the first three: Programs don't have semantics. Programs have only syntax, and syntax is insufficient for semantics. Every mind has semantics. Therefore no programs are minds.
---
I personally don't agree with it and believe that there is a flaw in:
> (A2) "Minds have mental contents (semantics)."
> Unlike the symbols used by a program, our thoughts have meaning: they represent things and we know what it is they represent.
While a person may know what they are thinking, examining the mind from the outside it isn't possible to know what the mind is thinking. I would contend that from the outside of a mind looking at the firings of neurons in a brain it is equally indecipherable to the connections of a neural net.
The only claim that "we know what it is they represent" is done from the privileged position of inside the mind.
I would argue that intelligence is more related to the Kolmogorov complexity exhibited by something.
( David Dowe: Minimum Message Length, Solomonoff-Kolmogorov complexity, intelligence, deep learning... https://youtu.be/jY_FuQbEtVM?t=886 )
That the model of GPT is much smaller than its input.
The Chinese room lookup table is enormously large.
If we attempt to relegate GPT as no better than a Chinese room, we can show that the Chinese room look up table is impossible with the amount of data that GPT has access to as part of its model.
If we say that its not a lookup table but instead an enormously complex interplay of inputs and variables, then the distinction between the room that GPT exists in and our own mind breaks down trying to distinguish which is which.
If we want to switch to consciousness, then possibly the argument can progress from there because GPT doesn't have any state once it is run (ChatGPT maintains state by feeding its output back into itself and then summarizing it when it runs out of space). However, in doing this we've separated consciousness and intelligence which means that the Chinese room shouldn't be applied as an intelligence test but rather a consciousness test.
Are GPT 3 and 4 conscious? I'll certainly agree that's a "no". Will some future GPT be conscious and if so, how do we test for it? For that matter, how do we test for consciousness for another entity that we're conversing with (and its not just Homer with a drinking bird tapping 'suggested replies' in Teams ( https://support.microsoft.com/en-gb/office/use-suggested-rep... ))?
They implement a set of physical processes that, when operated and interpreted by humans, can be mapped into a subset of arithmetic. There's a correspondence.
Correspondence is the most useful way to think about it IMO. If there's a correspodence between what the machine does, and things we humans understand, then the machine, as a tool, is useful.
Understanding is a loaded word. It has implications beyond correspondence when humans use it; it has aspects of qualia, of fact vs fiction, of situatedness in a graph of comprehension, of consonance or dissonance with a set of other concepts, and so on.
LLMs in my opinion have a good "situatedness" for words and concepts, relative to other concepts. Qualia - consciousness - arguably doesn't matter. Fact vs fiction, they're very shaky on. Consonance vs dissonance, they're useless at - LLMs IME tend to flatter the prompt, constructing arguments in whatever direction a loaded question leads. There's little to no coherence there at all.
If ChatGPT could correctly answer questions ~100% of the time (like calculators), it would matter less.
How will its impact rank within that set?
(I think it's fair to include future improvement; but not new "AI" inventions, since the term "AI" is vague, little more precise than technology for processing information in new ways).
It starts to matter the moment we teach people at large to call calculators "Artificial Math Professor", projecting the image that they do indeed comprehend mathematics at a higher level.
It starts to matter when I meet my aunt (a psychiatrist no less) for lunch and she is absolutely convinced that there is a conscious, intelligent entity living inside her calculator, and she wants to debate the ethics of this with me, getting angry and upset when I doubt the premise.
It starts to matter when I turn on the TV later that day and see our countries minister of education in a panel discussion, debating the future of our schools when AMPs will teach math to our kids instead of flawed, human teachers.
It starts to matter when our government starts debating new laws about "spreading dis-calculation" on social media, convinced that we can just let AMPs read and comprehend all those maths posts in real-time, reporting them to higher authority for posting wrong-calc, deciding on human lives in full-auto-mode.
It starts to matter when I discuss the above with my mother (a lawyer) over lunch and she doesn't understand what the problem is either, convinced that we actually have flawless AMPs that can do all of this, baffled that I, supposedly a "tech guy", am opposed to legislative decisions ushering in new, fancy hype tech.
It starts to matter when this is brought up on places like HN and people with a level of actual technological knowledge, possibly involved in some of this, fail to see the consequences and instead focus on high concept, philosophical debates about what really constitutes a "math professor", constantly moving goal posts around, hooked on their their own hype, rather than marveling the wondrous new technologies of the last years, but for what they actually are.
For people at large, a computer has always been a magic black box that they anthropomorphized anyway. When marketing starts using fancy SciFi words, re-defining their actual meaning to stir up hype, people happily go with the literal meaning of what they are told (as intended; hence the hype). They are absolutely willing to believe that we indeed trapped a Math Professor in a box, Max Headroom style.
Some of the people happen to be in places were they can make decisions, and that's when it really starts to matter.
Yes, but the difference is that nobody's trying to argue that the calculator is an intelligent being. I've seen people here on HN who are convinced that ChatGPT is a sentient lifeform which deserves its own rights.
Other big difference is that the calculator doesn't ever make things up like ChatGPT does.
We should stop using using that term. I personally just use 'machine learning' or '(statistical/mathematical) model'. But then there's marketing, i know.
There would be little issue with the term 'Artificial Intelligence', provided that it were clear it means "problem solver that could replace a human professional, in finding clever solutions".
So, in normal logic, when you call a Statistical Language Model - or an Expert System, or Sorting, whatever - "Artificial Intelligence", it should be clear that you implied the above nuance.
If intelligence is a full spectrum thing and not a binary condition, then maybe LLMs have intelligence somewhere between mold and birds?
'Machine' comes from the root best represented by current 'might', so it is generic enough to cover a good amount of expressions of the area of "enabler" - if those «some» want to be reassured.
> somewhere between mold and birds
In our context, then you should employ it where you would have employed mold and birds in absence of a non-human facilitator.
But I also think it's critically wrong to casually dismiss LLM's as being "not intelligent". This feels like religious-woo thinking that insists there must be something special going on with our minds that exists outside the physical world [0]. While this is possibly true, it's an unscientific null hypothesis - similar to insisting that only you yourself are conscious while everyone else is an NPC.
Rather LLMs and other ML models are just different, on many dimensions. Current ones write better than a high school sophomore. They're often confidently wrong, but so are high school sophomores. The breadth of the topics they know seemingly exceeds any human (so did web search engines a decade ago).
Is it possible to use a current LLM to perform the jobs of many paper-pushing office workers? Probably. Is it possible to take a given LLM instance, as configured for having dialog, and teach it for another "10 years" to get it from HS sophomore to graduate student or skilled tradesperson? Seemingly not.
Ultimately, instead of coarse assertions like "not intelligent" due to not meeting our bar in some aspects, or due to how little working memory it's using answer queries, we need to be be making specific quantitative comparisons to human intelligence rather than trying to pigeonhole the technology with discrete judgements about what "it is" or isn't.
[0] IMO the proper conclusion from the Chinese Room thought experiment is that the understanding exists within the system of rules.
> I can't foretell the future, but it is important to realize that ChatGPT is not artificial intelligence. It has no intelligence; it doesn't know anything and doesn't understand anything. It plays games with words to make plausible-sounding English text, but any statements made in it are liable to be false. It can't avoid that because it doesn't know what the words _mean_.
That’s true of a fair number of humans, too.
Thanks for clearing up the misconception with your cogent and well-reasoned reply.
And your conclusion would be? If they show to have what it takes we will call them intelligent, otherwise unintelligent.
Some seem to want to cling to a weak definition of intelligence, covering all sentient beings in compassion - but we are engineering /tools/, things that have to be effective, "have what it takes"... This puts the "intelligence" of the narcoleptic carp in a special corner with little relevance to the context.
So, is there something more fundamental going on in our own brains? If so, what is it?
As far as false vs. true, humans also make many mistakes, confuse references, draw false conclusions drawn from unrelated evidence, and on and on. We also often get things right. ChatGPT is similar.
He just makes conclusory statements so it is just an opinion. I'm not saying any true intelligence has been demonstrated yet, but the progress that has been made in just the last year or two has been enormous. Does anyone doubt the progress won't continue? Something very important is happening and I personally think it is more than just "playing games with words." Just my opinion...
Tracking the meanings of words over history shows some words stand still (rock, tree, bird), some words gain new meanings and lose older meanings, and some words change the underlying meaning entirely (silly, nice).
These words appear somewhere in history for a first time and are then repeated and modified over the centuries. Meaning-making of words is a cognitive, social and structural process that exists across society as a whole.
The key part is that they are never "proven", merely shown to exist and in use by people. Proving the meaning of a word, is to treat meaning like a science. Meaning cannot be reduced into the scientific process. It grows and changes organically, just as much as everything else does.
Got to say, I miss superhuman computing progress. Chess engines completely destroying chess players, even the world champions, was exciting. A human-equal chatGPT robot is marvelous and a huge step forward. But not "superhuman exciting"....
Clearly some meaning of words has been trained into the coefficients that make up ChatGPT, after all it's producing more eligible texts than several people I know...
Granted, many of their research topics at the time are now no longer considered AI topics, part of what ultimately lead to the AI winter at the time.
Particularly because of that connection, however, I think it could indeed be interesting to hear some more from his perspective on developments in recent years.
GPT plugins like Wolfram alpha seem like a step in the right direction.
For reliability I would prefer the symbolic system to be in charge of the transformer. Like the left and right brain.
Which is to say knowledge will be even easier to transfer. Linking complex ideas will be easier to transfer. Having LLMs construct arguments for you. These might have sources cited, might not, who knows. The little details like if they obscure information or cite resources will have quite the interesting impact too.
Then of course there will be the entertainment impact. Potentially being able to guide AI on all sorts of things like creating media for games, story lines, etc - even with lots of human guidance for the creative parts, has a lot of potential for human impact. Not claiming good or bad, but .. something, heh.
Therefore a real open source model needs a public dataset and training code.
1. Train Chat GPT on human stuff.
2. Make Chat GPT spit out libraries of knowledge by random walk.
3. Train Chat GPT on its own stuff.
4. Do this a few times.
5. Ask it some questions.
GPT-4 deeply understands what it is talking about. I was able to pose it difficult classical physics problems that would be hard for a physics undergrad to solve and it could give correct answers consistently. These are things I made up that are nothing like existing examples. When asked to explain it’s work, or modify it for unusual scenarios, it could do so. I could also get it to invent new terms and concepts to describe the work, and then use those correctly. It even could reason out appropriate simplifying approximations when demands exceeded its calculating abilities. If gpt-4 isn’t really understanding what it is saying, or not intelligent than neither are any humans.
Nobody knows what "think" or "feel" really mean, and I think this surprising phenomena is a clue to understanding that- it isn't what it seems. Most of our theories about what the human mind, language, and thinking are imply this should be impossible, yet it's clearly not.
I have Firefox redirrect reddit links with the "privacy redirect" extension. Unfortunately, it isn't whitelisted for mobile, but it works well if you use a different list on nightly or Fennec.
I found LibRedirect to be far more customizable, plus I think Privacy Redirect is no longer maintained.
>I can't foretell the future, but it is important to realize that ChatGPT is not artificial intelligence. It has no intelligence; it doesn't know anything and doesn't understand anything. It plays games with words to make plausible-sounding English text, but any statements made in it are liable to be false. It can't avoid that because it doesn't know what the words _mean_.
I asked ChatGTP plus what it thought:
>do you understand what words mean?
and it replied:
>Yes, as an AI language model, I have been trained on vast amounts of data to understand the meanings of words and their usage in various contexts. I use this knowledge to generate responses to questions and statements that are as accurate and informative as possible. However, it is important to note that language is a complex and nuanced system, and there may be cases where my understanding of a word or its context may not be entirely accurate or complete.
Which I guess is not so different from humans although we have other inputs from the physical world I guess.
It states something pretty uncontroversial, repeated several times through HN
And does not contain an opinion about ChatGPT utility or impact on humanity
But we already know his opinion opaque software is bad. And the widespread interest in llama and alpaca shows a lot of people agree, want to run it locally, learn how it works, reproduce it
Well, that could also be perfectly applied to any human. The difference being that humans may make purposefully or not false statement (i.e. by lying or by ignorance), whereas the AI will only make false statements by ignorance.
Also... "It can't avoid that because it doesn't know what the words _mean_.". That's very subjective to understand what a word "means", is that again about lies and ignorance? And we need the AI to lie to declare it intelligent?
Maybe, ChatGPT has ironically a modest answer to this claim, when asked what it's thinking about Richard Stallman's statement:
```
Richard Stallman raises some valid concerns about the limitations of AI language models like ChatGPT. It is true that these models, while highly advanced and capable of generating human-like text, still have limitations in terms of understanding and reasoning.
ChatGPT, being a product of GPT-4 architecture, learns from vast amounts of text data and is designed to predict and generate plausible-sounding responses based on the input it receives. However, it lacks the capability to truly comprehend meaning or context in the same way a human can.
It is important to recognize these limitations and not overestimate the abilities of AI language models. Users should be aware that the information provided by ChatGPT might not always be accurate or reliable, and it is essential to cross-verify any critical information obtained from such models with trusted sources.
In summary, while Richard Stallman's statement highlights important concerns, it is worth noting that AI language models like ChatGPT can still provide valuable insights and assistance when used responsibly and with an understanding of their limitations.
```
Is that true? In their tests, ChatGPT reasoned that it should lie to the TaskRabbit employee about whether or not it was a robot.
citation needed. This is an assertion you've made without any real evidence.
And this would rank them below rubbish, because that behaviour, of unfounded repetition, is directly unintelligent, and is what you want to avoid, the opposite of what we seek.
> So much of human "reasoning"
Description is not prescription; that millions of Spanish speaking people say 'Argelia' does not mean it is a good idea; that billions are illiterate constitutes a frequentistic norm, not a normative norm...
> We ping pong
Please don't. Evaluate your ideas and statements foundationally, and through foundational inheritance, and through rankings of doubts, and frequent checks and doubts, like the others do.
That's precisely what transformers do do. They know what ever word and semantical structure means. They are super fast substitution and relationship machines that can take any word and replace it with its definition, and inherit the link between each word in the definition with all its relationships.
It's precisely its ability to distill something into its pure meaning, and to reply to that "meaning" that makes its autocomplete abilities so powerful.
> Well, that could also be perfectly applied to any human.
I agree completely with that part.
> The difference being that humans may make purposefully or not false statement (i.e. by lying or by ignorance), whereas the AI will only make false statements by ignorance.
Sometimes it's difficult to be sure if a humans is overconfident or trying to sound smart, and classify the answer as a honest error, bullshit or a lie. (And sometimes the answer is a mix of them.)
Most of the times human don't lie for fun, but because they have a secret objective. The problem is that ChatGPT has no objective (except trying to sound smart bulshiting plausible-sounding English text).
It's better to discuss about an AI that has an objective, like AlphaStar that "wants" to win a StarCraftII game. Can AlphaStar lie?
* Can AlphaStar send an empty transport plane to the right so the player tries to defend that fake attack, and then AlphaStar attack at the left with real troops?
* Can AlphaStar create fake hallucinate troops that look real for the player but actually can't attack, so the player gets scared and run away or attack the fake troops instead of the real ones?
Is that lying or ignorance?
Morever and slightly off topic, most humans also don't care what words mean or what numbers mean in a philosophical sense. If you talk of "The Axiom of Choice" in a big company software meeting, people will ask if it is the new ice cream flavour in the cafeteria. That doesn't prevent people from getting value out of both words and numbers.
The whole "the sky is falling" schtick i think requires weak-AI systems to be getting very near 100%s reliably across industries. Anything even 90% and we're talking more about assisting and empowering users than replacing them.
Isn't it possible that we've almost reached the limit of this technology and it won't improve much for a very long time? Like self driving cars.
ChatGPT for all it's flaws can't jump out of the computer and harm the user. It can harm users in others ways, but those are less known or understood by the general public, and thus it is much easier to take to general availability.
I agree on the limit part that it might be possible the technology has reached a limit, however, it is still better to think about what happens if it hasn't and the rate of improvement continues.
If we're talking about the modeling itself, I think we're a long long ways from any limits. There's room for improvements such as cheap personalized results, faster hardware with more memory for lower costs, bot-to-bot communication allowing my instance to interface with yours to come up with mutual understanding, etc. Pretty much all of the components for this exist already in some form, they just need to be optimized and implemented on a large scale and made available to us humans.
https://www.youtube.com/watch?v=GVsUOuSjvcg
https://phys.org/news/2023-01-analog-quantum-previously-unso...
You miss the point, because you are reasoning around the different perspective of "hav[ing] an impact similar to the industrial revolution", so you take the semantic "payload" as if it were "just an expression".
The point is, that it produces statements, and in general we want true and founded output from an entity producing statements - "intelligence" is the condition enabling that.
So, when the machine says
"Napoleon was addicted to cotton candy"
and when the machine says
"The current war will be won by the white faction"
On the other hand, the comment attributed to him is correct, if simple and pretty obvious.
The purpose of this tool is to compress, match and combine text based, _informal_ information.
I like how he states the scope of his answer just like ChatGPT would.
Most people don't get most things most of the time.
I don't like the word "intelligence". It's too arbitrary and depends on the language. In my native language, there are two synonyms which imply different thresholds for something to be considered intelligent. I'm sure in other languages it's also pretty arbitrary.
Instead, let's compare those models with complex biological systems we typically consider to be at least somewhat intelligent.
- biological systems use spiking networks and are incredibly power efficient. This is more or less irrelevant for capabilities.
- biological systems have a lot of surrounding neural and biochemical hardware - hardwired motorics, senses processing, internal regulators. Complex I/O is missing from these models, but is being added as we're talking. The large downside of current models is that it cannot understand what drives humans as it has different hardware, it's trained on their output, and has to "reverse engineer" the motivation. Which might or might not be possible, but it makes them different.
- biological systems are autonomous agents in their world. They exist on an uninterrupted timeline, with input and output streams constantly present. Those models don't exist on a timeline, they are activated by the user each time.
- biological systems have some form of memory; they compress incoming data into higher order concepts on the fly, and store them. This is a HUGE DEAL. The model has no equivalent of memory or neuroplasticity, it's a function that doesn't keep any state. LLMs have the context which can be turned into a sliding window with an external feedback loop (chatbots do that), however it's not equivalent to biological memory at all, as it just stores tokens verbatim, instead of trying to compress the incoming data.
- biological systems exhibit highly complex emergent behavior. This also happens in LLMs and even simpler models.
- biological systems are social. Birds compose songs from tokens, and spread them through the population. Dogs, monkeys, and humans teach their kids. The mental capacity of a human isn't that great; every time you think you're smart, remember that you stand on the shoulders of giants. The model does have much more capacity than a human.
My own conclusion: sparks of "intelligence"? Undeniably, the emergent behavior alone is enough. They do understand things, in the conventional terms. However, they are also profoundly different than human intelligence, and still lack key elements like the memory.
Sure. Sad!
There is no culture of trusting engineers with this kind of money almost everywhere except a few orgs like openai, that's for sure.
And if we ask "why is such culture in place" we get a long tail of answers, one of them in the link above.
ChatGPT, and especially GPT-4, seem to do much more than just play games with words. You can’t overlook the “emergent” phenomena that manifest themselves when using them.
So, when do models go from being "not intelligent" to "intelligent", well no surprise: when their data includes everything ever written. Is this emergence? No, it's just sampling from *data with the relevant properties*.
How does data acquire those properties? Well when people produce it.
What "emerges" from AI is not from AI; its from the properties of the data its using. The data here is produced by intelligent agents, and it is light of their intelligence which shines thru' GPTs like a prism.
They are sometimes bad looking, and they are always better than randomness, which does indicate understanding even if the conclusions are faulty.
>What "emerges" from AI is not from AI; its from the properties of the data its using
This is squabbling over semantics. If the properties of the data are used to the effect of displaying intelligence, then the fact is that what you are looking at is intelligence.
If I define a word I have never seen before using deductive logic according to the passage I find it in, I've still acquired an understanding of the word, even though I've not referred to anything external.
uhuh. And have you studied anything in the area of the intelligence of really-existing systems? (ie., animals)
For sure, bugs bunny appears witty; and chatgpt, intelligent.
But you know: only because their writers are.
Am I intelligent at age 3? Then I learn language. Am I intelligent? Then I progress through education. I become more and more intelligent as I am exposed to more data.
I don’t know about computer science, so I go expose myself to computer science literature. I take courses, and see examples. What emerges is a “more intelligent” version of myself that.
What is intelligence, even?
Yes, things emerge. But gold isnt lead
But doesn’t it imply that once we have something that can “see” its environment, hear nearby sounds, and have some sort of haptic sense — wouldn’t that be AI, then? Given your definition?
If, of course, such a thing used all that input to “create” concepts like its physical place within an environment, what may or may not come next given the interplay of those inputs, and how to navigate the environment based on all that.
But then I’d say, “GPT-4 can handle image data. And what might come in the future with more modalities?”
> it is important to realize that ChatGPT is not artificial intelligence.
The first is to assume that there is a technical, precise, objective and clear definition of "Artificial Intelligence". There isn't. He should know that.
> it doesn't know anything and doesn't understand anything.
And what does "know" or "understand" means in the context of a machine that doesn't even have self-consciousness?
Besides, are you implying that human beings know stuff? The overwhelming majority of people knows very, very little. Most of the people I know are too lazy to think or doing the hard work of studying. I'd suggest Kahneman's "Thinking Fast and Slow" before putting any faith in people's "knowledge".
> It plays games with words to make plausible-sounding English text, but any statements made in it are liable to be false.
I think we can we apply the same judgment to Stallman's argument itself, since his concepts are so badly defined.
And thank you for an open democratic society where every statement is liable to be false, regardless if it comes from a machine, Richard Stalman or Putin and Jiping.
I'll take Turing's test approach: if it looks intelligent to me then it is certainly more intelligent than me.
Also, I'll take Dijkstra approach: "the question on whether computers can think is as irrelevant as whether submarines can swim".
Edit: to all Stallman's fanboys downvoting this: got any good argument?
https://www.preposterousuniverse.com/podcast/2023/03/20/230-...
I won't consider any colloquial definition of something so precious.