Hacker News Reader

Comment by Kadam257 | Hacker News Reader

The problem isn't that Claude's responses are unimpressive. They are impressive. The problem is that impressive outputs don't tell you anything about underlying mechanism, and mechanism is what consciousness is about. A system optimized via RLHF to produce responses that make smart humans say "wow" will produce responses that make smart humans say "wow". That's what it was trained to do.

View on HN

The problem the Turing test was meant to solve is that we had, and still have, no means of recognizing a conscious mechanism. We lack a theory of consciousness that can be used to make a better test than "It could fool me", so the Turing test accepts that as the test.

In other words, the mechanism may be what consciousness is about, but we can't say anything useful about this as relates to consciousness.

> We lack a theory of consciousness [...]

Nitpick: off course we don't really lack a theory of consciousness. It's just that Alan Turing choose to ignore all the existing prior discourse in humanities and philosophy.

There are many theories of consciousness but nobody knows if one of them is correct and nobody can use one of them to build a conscious machine. Compare that to theories of physics. None of them is 100% correct but they give us the tools we are using to write these messages.

I've got a theory of consciousness, not a very complicated one, that could be used in a machine. Basically that it evolved as a practical way for animals to make decisions like whether to run from a predator. To do that info from the billions of neurons handling senses memories and the like filter down to something like a situation summary, which is basically what the animal is conscious of which then feeds to the decision making, thinking and remembering and neurons.

It would be quite interesting if/when someone tries that to see how close it is or isn't to nature.

So, your theory says it's about prediction, estimation, extrapolation? Like a Kalman filter?

I'm thinking of the first episode of Alex Garland minisery Devs, where a somewhat brilliant Russian guy demos predicting the exact movements of a bacteria. That would be proof that the model works. And even it it were to mispredict, most of the time, it sounds plausible.

To be honest I'm not that up on those terms but I figure given that life evolved the functionality must be something like what I mentioned. I'll have a read up.

Nitpick nitpick: If you look at Turing's paper https://courses.cs.umbc.edu/471/papers/turing.pdf and ^F for consciousness you'll find that's not entirely true.

The Turing test isn't a test for whether a machine is conscious but whether it can think.

>mechanism is what consciousness is about

I don't see it that way - it's more about awareness of sights sounds feelings thoughts and the like. I've got little idea what mechanism my brain uses and don't think it matters much.

It's like Descartes didn't say I think, therefore I may be but only if the thinking uses biological neurons.

Reply on news.ycombinator.com