Hacker News Reader

Comment by SigmundA | Hacker News Reader

I read Blindsight long before modern LLM AI came about and at the time I thought the aliens being intelligent without being conscious was fascinating and gave me a different perspective that those things could be separated but it didn't have and direct application.

Learning how modern AI's respond immediately made me think about how Rorschach was communicating with the crew and how current LLM AI's might be considered intelligent while not conscious.

https://en.wikipedia.org/wiki/Blindsight_(Watts_novel)#Consc...

View on HN

How do you even know that LLMs are not conscious?

I've just skimmed the Wikipedia entry you linked:

  the linguist realizes that the alien creatures cannot be, in fact, conscious because of their lack of semantic understanding:

  "Our cousins lie about the family tree," Sascha replied, "with nieces and nephews and Neanderthals. We do not like annoying cousins."
  "We'd like to know about this tree."
  Sascha muted the channel and gave us a look that said Could it be any more obvious? "It couldn't have parsed that. There were three linguistic ambiguities in there. It just ignored them."

So it turns out I'm not conscious either and incapable of semantic understanding, because I've ignored the ambiguities too. Though note that parsing ambiguous sentences used to be exactly what pre-LLM AIs could not do, and what we thought of as requiring real understanding. The exact opposite of what Watts seems to claim.

They can’t, because consciousness is ill defined. It means something different to every person that engages in this debate.

> So it turns out I'm not conscious either

That is an option. I think we are philosophical zombies a decent chunk of the time. Constant self awareness and mindfulness are calorically expensive. No reason consciousness has to be continuous.

Could be. However note that any current LLM passes this ambiguity parsing test with flying colors- both the implicit choice of the most probable meaning and the subsequent reflection on all the possible alternatives- so if that proved anything it would mean that they're conscious too.

Yeah, this test is poor. Turing test broke a while ago. Blindsight was written while it was still considered a thing. One of it's limitations.

A Chinese Room that isn't one.

Reply on news.ycombinator.com