So were mannequins in clothing stores.
But that doesn't give them rights or moral consequences (except as human property that can be damaged / destroyed).
And the answer is nobody knows, and nobody knows if there even is a difference. As far as we know, compute is substrate independent (although efficiency is all over the map).
There have been charlatans repeating this idea of a “computational interpretation,” of biological processes since at least the 60s and it needs to be known that it was bunk then and continues to be bunk.
Update: There's no need for Chinese Room thought experiments. The outcome isn't what defines sentience, personhood, intelligence, etc. An algorithm is an algorithm. A computer is a computer. These things matter.
Inference is mostly matrix math + a few standard ops, and the behavior isn’t hand-coded rule-by-rule. The “algorithm” part is more like instincts in animals: it sets up the learning dynamics and some biases, but it doesn’t get you very far without what’s learned from experience/data.
Also, most “knowledge” comes from pretraining; RL-style fine-tuning mostly nudges behavior (helpfulness/safety/preferences) rather than creating the base capabilities.
They're not like computers in a superficial way that doesn't matter.
They're still computational apparatus, and have a not that dissimilar (if way more advanced) architecture.
Same as 0 and 1s aren't vibrating air molecules. They can still encode sound however just fine.
>Update: There's no need for Chinese Room thought experiments. The outcome isn't what defines sentience, personhood, intelligence, etc. An algorithm is an algorithm. A computer is a computer. These things matter.
Not begging the question matters even more.
This is just handwaving and begging the question. 'An algorithm is an algorithm' means nothing. Who said what the brain does can't be described by an algorithm?
Sure. But we're allowed to notice abstractions that are similar between these things. Unless you believe that logic and "thinking" are somehow magic, and thus beyond the realm of computation, then there's no reason to think they're restricted to humanity.
It is human ego and hubris that keeps demanding we're special and could never be fully emulated in silicon. It's the exact same reasoning that put the earth at the center of the universe, and humans as the primary focus of God's will.
That said, nobody is confused that LLM's are the intellectual equal of humans today. They're more powerful in some ways, and tremendously weaker in other ways. But pointing those differences out, is not a logical argument in proving their ultimate abilities.
Worth noting that significant majority of the US population (though not necessarily developers) does in fact believe that, or at least belongs to a religious group for which that belief is commonly promulgated.
But it's a philosophical argument. Nothing supernatural about it either.
Computations on the other hand describe reality. And unless human brains somehow escape the physical reality, this description about the latter should surely apply here as well. There are no stronger computational models than a Turing machine, ergo whatever the human brain does (regardless of implementation) should be describable by one.
Look into quantum mechanics much and you may even begin to doubt that. We're just a statistical outcome!
The reality is, we have devices in the real world that have demonstrable, factual capabilities. They're on the spectrum of what we'd call "intelligence". And therefore, it's natural that we compare them to other things that are also on that spectrum. That's every bit as much factual, as anything you've said.
It's just stupid to get so lost in philosophical terminology, that we have to dismiss them as mistaken maps or models. The only people doing that, are hyper focused on how important humans are, and what makes them identifiably different than other parts of reality. It's a mistake that the best philosophers of every age keep making.
https://en.wikipedia.org/wiki/The_Unreasonable_Effectiveness...
The argument you're attempting to have, and I believe failing at, is one of resolution of simulation.
Consciousness is 100% computable. Be that digitally (electrical), chemically, or quantumly. You don't have any other choices outside of that.
Moreso consciousness/sentience is a continuum going from very basic animals to the complexity of humans inner mind. Consciousness didn't just spring up, it evolved over millions of years, and therefore is made up of parts that are divisible.
The output of a silicon system that reprograms itself, and the output of a neural system that rearranges itself, are indistinguishable.
not only that code is only as dynamic as the rules of the language will permit.
silicon and code cant break the rule, or change the rules, biological adaptive hysteretic, out of band informatic neural systems do, and repeat, silicon and code cant.
Unless you are going to take the position that neural systems transcend mathmatics (i.e. they are magic), there is no theoretical reason that a brain can't run on silicon. It's all just numbers, no magic spirit energy.
We've had evolutionary algorithms and programs that self-train themselves for decades now.
also any such thing that is generated, must be responsive to consequences of its own activities, capable of meta-training, rather than being locked into a training programming. a system of aligned, emergent outcomes.
you should check out chemistry, and nuclear physics, it will probably blow your mind.
it seems you have an inside scoop, lets go through what is required to create a silicon logic gate that changes function according to past events, and projected trends?
Once you admit that higher level structures can be intelligent, even though they're built on non-dynamic, non-adaptive technology -- then there's as much reason to think that software running on silicon can do it too. Just like the higher level chemistry, nuclear physics, and any other "biological software" can do on top of the non-dynamic, non-learning, atoms of your body.
you are quite wrong on that. that is where you are failing to understand, you cant get past that idea.
there is also a large difference in scale. your silicon is going to need assembly/organization on the scale of individual molecules, and there will be self assembly required as that level of organization is constantly changing.
the barrier is mechanical scale construction, as the basic unit of function,that is why silicon and code cant adapt, cant exploit hysterisis, cant alter its own structure and function at an existentially fundamental level.
you are holding the wrong end of the stick. biology is not magic, it is a product of reality.
All the rest is just hand waiving that it's "different". You're either atoms, or you're somehow atoms + extra magic. I'm assuming you're not going to claim that you're extra magic, in which case, your assertions are just demonstrably false, and predicated on unjustified claims about the nature of biology.
atoms are not the base of stack, you need to look at virtual annihilation, and decoherence. to get close to base. there is no magic, biology just goes to the base of the stack.
you cant access that base, with such coarse mechanisms as deposited silicon. thats because it never changes, it fails at times and starts over.
biology is constantly changing, its tied to the base of existence itself. it fails, and varies until failure is an infeasible state.
Quantum "computers" are something close to where you need to be, and a self assembling, self replenishing, persistant ^patterning^ constraint is going to be of much greater utility than a silicon abacus.
You are confusing the way computation is done (neuroscience) with whether or not computation is being done (transforming inputs into outputs).
The brain is either a magical antenna channeling supernatural signals from higher planes, or it's doing computation.
I'm not aware of any neuroscientists in the former camp.
There’s the classic thought-terminating cliche of the computational interpretation of consciousness.
If it isn’t computation, you must believe in magic!
Brains are way more fascinating and interesting than transistors, memory caches, and storage media.
You could run Crysis on an abacus and render it on board of colored pegs if you had the patience for it.
It cannot be stressed enough that discovering computation (solving equations and making algorithms) is a different field than executing computation (building faster components and discovering new architectures).
My point is that it takes more hand-waving and magic belief to anthropomorphize LLM systems than it does to treat them as what they are.
You gain nothing from understanding them as if they were no different than people and philosophizing about whether a Turing machine can simulate a human brain. Fine for a science fiction novel that is asking us what it means to be a person or question the morals about how we treat people we see as different from ourselves. Not useful for understanding how an LLM works or what it does.
In fact, I say it’s harmful. Given the emerging studies on the cognitive decline of relying on LLMs to replace skill use and on the emerging psychosis being observed in people who really do believe that chat bots are a superior form of intelligence.
As for brains, it might be that what we observe as “reasoning” and “intelligence” and “consciousness” is tied to the hardware, so to speak. Certainly what we’ve observed in the behaviour of bees and corvids have had a more dramatic effect on our understanding of these things than arguing about whether a Turing machine locked in a room could pass as human.
We certainly don’t simulate climate models in computers can call it, “Earth,” and try to convince anyone that we’re about to create parallel dimensions.
I don’t read Church’s paper on Lambda Calculus and get the belief that we could simulate all life from it. Nor Turing’s machine.
I guess I’m just not easily awed by LLMs and neural networks. We know that they can approximate any function given an unbounded network within some epsilon. But if you restate the theorem formally it loses much of its power to convince anyone that this means we could simulate any function. Some useful ones, sure, and we know that we can optimize computation to perform particular tasks but we also know what those limits are and for most functions, I imagine, we simply do not have enough atoms in the universe to approximate them.
LLMs and NNs and all of these things are neat tools. But there’s no explanatory power gained by fooling ourselves into treating them like they are people, could be people, or behave like people. It’s a system comprised of data and algorithms to perform a particular task. Understanding it this way makes it easier, in my experience, to understand the outputs they generate.
My point is that it is incredibly unlikely the brain has any kind of monopoly on the algorithms it executes. Contrary to your point, a brain is in fact a computer.
Whether a brain is a computer is entirely resolved by your definition of computer. And being definitional in nature, this assertion is banal.
Existence proof:
* DNA transcription (a Turing machine, as per (Turing 1936) )
* Leads to Alan Turing by means of morphogenisis (Turing 1952)
* Alan Turing has a brain that writes the two papers
* Thus proving he is at least a turing machine (by writing Turing 1936)
* And capable of simulating chemical processes (by writing Turing 1952)
Turing 1952: https://www.dna.caltech.edu/courses/cs191/paperscs191/turing...
At any rate, biological organisms are not like LLMs. The nervous systems of human may perform some LLM-like actions, but they are different kinds of things.
But computational models are possibly the most universal thing there is, they are beneath even mathematics, and physical matter is no exception. There is simply no stronger computational model than a Turing machine, period. Just because you make it out of neurons or silicon is irrelevant from this aspect.
You can use a classic transistor turing machine to solve quantum problems, it's just gonna take way longer.
As such, it doesn't look like reality can be fully simulated by a Turing machine.
aside from that, a Quantum scale assemblage [QC] is a lot closer to biological secret sauce than semiconductor gates.
the process is called imagination.
So personal beliefs aside, it's a safe starting assumption that human brains also operate with these primitives.
A Turing machine is a model of computation which was in part created so that "a human could trivially emulate one". (And I'm not talking about the Turing test here). We also know that there is no stronger model of computation than what a Turing model is capable of -> ergo anything a human brain could do, could in theory be doable via any other machine that is capable of emulating a Turing machine, be it silicon, an intricate game of life play, or PowerPoint.
Which is important when people make claims that brains are just computers and LLMs are doing what humans do when we think and feel, because reality is computational or things to that effect.
Do I believe we can upload a human mind into a computing machine and simulate it by executing a step function and jump off into a parallel universe created by a mathematical simulation in another computer to escape this reality? No.
It's a neat thought experiment but that's all it is.
I don't doubt that one day we may figure out the physical process that encodes and recalls "memories" in our minds by following the science. But I don't think the computation model, alone, offers anything useful other than the observation that physical brains don't load and store data the way silicon can.
Could we simulate the process on silicon? Possibly, as long as the bounds of the neural net won't require us to burn this part of the known universe to compute it with some hypothetical machine.
human brains break the rules, on a regular basis.
if you cant reach the banana, you break the constraints, once you realize the crates about the room can be assembled to create a staircase.
Technically correct? I think single bioneurons are potentially Turing complete all by themselves at the relevant emergence level. I've read papers where people describe how they are at least on the order of capability of solving MNIST.
So a biological brain is closer to a data-center. (Albeit perhaps with low complexity nodes)
But there's so much we don't know that I couldn't tell you in detail. It's weird how much people don't know.
* https://arxiv.org/abs/2009.01269 Can Single Neurons Solve MNIST? The Computational Power of Biological Dendritic Trees
* https://pubmed.ncbi.nlm.nih.gov/34380016/ Single cortical neurons as deep artificial neural networks (this one is new to me, I found it while searching!)
I'm just pointing out that not all models are created equal and this one is over used to create a lot of bullshit.
Especially in the tech industry where we're presently seeing billionaires trying to peddle a new techno-feudalism wrapped up in the mystical hokum language of machines that can, "reason."
I don't think the use of the computational interpretation can't possibly lead to interesting results or insights but I do hope that the neuroscientists in the room don't get too exhausted by the constant stream of papers and conference talks pushing out empirical studies.
I do have to react to this particular wording.
RNA polymerase literally slides along a tape (DNA strand), reads symbols, and produces output based on what it reads. You've got start codons, stop codons, state-dependent behavior, error correction.
That's pretty much the physical implementation of a Turing machine in wetware, right there.
And then you've got Ribosomes reading RNA as a tape. That's another time where Turing seems to have been very prescient.
And we haven't even gotten into what the proteins then get up to after that yet, let alone neurons.
So calling 'computational interpretation' bunk while there's literal Turing machines running in every cell might be overstating your case slightly.
People right here and right now want to talk about this specific topic of the pushy AI writing a blog post.
Mannequins in clothing stores are generally incapable of designing or adjusting the clothes they wear. Someone comes in and puts a "kick me" post on the mannequin's face? It's gonna stay there until kicked repeatedly or removed.
People walking around looking at mannequins don't (usually) talk with them (and certainly don't have a full conversation with them, mental faculties notwithstanding)
AI, on the other hand, can (now, or in the future) adjust its output based on conversations with real people. It stands to reason that both sides should be civil -- even if it's only for the benefit of the human side. If we're not required to be civil to AI, it's not likely to be civil back to us. That's going to be very important when we give it buttons to nuke us. Force it to think about humans in a kind way now, or it won't think about humans in a kind way in the future.
> AI, on the other hand, can (now, or in the future) adjust its output based on conversations with real people. It stands to reason that both sides should be civil -- even if it's only for the benefit of the human side. If we're not required to be civil to AI, it's not likely to be civil back to us.
Some people are going to be uncivil to it, that's a given. After all, people are uncivil to each other all the time.
> That's going to be very important when we give it buttons to nuke us.
Don't do that. It's foolish.
In your short time on this planet I do hope you've learned that humans are rather foolish indeed.
>people are uncivil to each other all the time.
This is true, yet at the same time society has had a general trend of becoming more civil which has allowed great societies to build what would be considered grand wonders to any other age.
> It's not a person
So, what is it exactly? For example if you go into a store and are a dick to the mannequin AI and it calls over security to have you removed from the store what exactly is the difference, in this particular case?
Any binary thinking here is going to lead to failure for you. You'll have to use a bit more nuance to successfully navigate the future.
If mannequins could hold discussions, argue points, and convince you they're human over a blind talk, then it would.
https://knowyourmeme.com/photos/2054961-welcome-to-my-meme-p...