> Communication between humans and machines is hindered by a lack of shared awareness.
Yeah... by the fact that humans aren't aware that AI is just a bunch of 1s and 0s and not actually aware. There's no intelligence here.
> Scene understanding
... it cannot understand. It can only match. It does not understand in the way humans understand.
And the human brain is just a bundle of electrical signals. Why's that any different?
Consciousness, sentience and sapience. Which is to say, that is indeed the multitrillion dollar question.
What makes something conscious?
Follow up: is that answer well-defined (it's not using other nebulous concepts to avoid having to rigorously define it), and does it accept all of the things you think should be called "conscious" and reject all of the things you think should not be?
the more we look the more we find that this is not the case. and i don’t have to invoke any philosophy here, just remind you that neurotransmitter modulation and glial cells exist.
Honestly, the root of all this is whether you were trying to claim that the brain is doing super-Turing computation or not. Either
1) it's not, then you can't tell me Turing machines cannot do the same computation (and by extension neural nets can approximate it)
2) it is, then prove it and congratulations you have made a extraordinarily important and fundamental step forward in computer science.
My money is on 1.
Certainly neither of them are action potentials, which are usually the (exclusive and therefore imo incomplete) basis for the mental model of people who claim things like "the brain is just electrical signals." No. It's not. It's a vastly more complicated system of organ(s) than that even if you're willing to draw a line in the sand between brain and environment -- and that's no easy feat itself!
This is relevant because the universal function approximaters we are training everyday are capable of representing this computational model, undermining the argument that there is somehow a difference between the model of computation done in the brain and the computation done by neural networks.
oh. well, that’s just a naive embrace of the andy grove fallacy.
as of this moment, the brain’s computational model (and if there is one, and if so how many) is neither well understood nor replicable.
it’s almost a category error to describe the process as “reverse engineering”, but even if that’s an appropriate mental model, it turns out that reverse engineering an evolved system that’s taken 4.5 billion years and has had no human design additions at all has very little in common with any similar approach you could take in, say, inspecting the trained weights of a neural network to back out what’s going on.
No it's not. That's about feasibility, and the comment was not about feasibility. It was about turing vs. super-turing.
Go ahead and assume the reverse engineers get 4.5 trillion years or something. That wasn't the point of the "actually aware" rebuttal.
And?
If it can match to a point where it knows exactly what everything is, and presumably is capable of (or eventually will be able to) making decisions based on that information well enough to obey the rules of the road, then it doesn't really matter if it's using trillions of simple logic gates or a human brain.
Human understanding enables inference. Say your full self driving car is driving down the freeway and an enormous explosion / forest fire / volcano erupts in the distance, it'll blissfully drive towards the disaster - because it has no comprehension of what the orange sky, shaking ground, fleeing people imply.
This is a extreme example but the more we learn about driving the more we realise our ability to do it is based on inference not only about the world, but about the intentions of other drivers.
There's no 'decision' being made by a self driving car - it's matching its predefined set of visual inputs to a set of behaviours. It can never scale to adapt to the unknown - even in principle.
> It can never scale to adapt to the unknown - even in principle.
But the human will be able to fill in for the inference cars don't have. Even if we get to level 5 where there's no steering wheel, the human can still control the car's destination and what sort of operation modes the car is in; if there is some event and full-scale panic ensues, the AI driver isn't going to hit people in the street - either the human can instruct it to turn around, or they can get out of the car, since even now it's not really safe try to weave between humans in the street to reach your destination.