> but I don't think it inherits the important bits through an 'assembly' process.
The "important bits" are presumably embedded during the design phase, leaving assembly to be little more than painting by numbers. A robot could do the assembly, but not yet the design - at least not its inventive part.
The shape of consciousness is encoded in both the hardware and the software we produce, most of which allows conditional actions on objects of some sort, just like we move in space and thought and act upon objects and notions.
The machine is supposed to help us do the stuff we usually do, so it's perfectly reasonable that we'll try to cram as many of our actions in it as possible. Think e.g. of the Swiss Army knife, or Emacs (and of Stallman as a computational McGyver).
Sure, perhaps it's the the shape of our understanding of consciousness, rather than of consciousness itself, but isn't consciousness something that can cross the species barrier with ease, should it find an appropriate new substrate?
Depends on how high or low you place the bar for the definition of consciousness, really. Calculations are thinking, open the door if someone authorized is at the door is thinking, fill in the blanks and complete the sentence are thinking, and we can offload all those thinkings to computers to do the thinking for us, like we offloaded storytelling to books and entertainment to MP4s. Like everything we do, we create images of ourselves here and there, and try to give them meaning.
But that's all philosophical considerations, trying to determine whether a duck is ontologically and epistemically a duck if it walks and talks like a duck.
The industry, on the other hand, tries to determine two entirely different things (preferably by Friday COB):
- Can you eat it like a duck?
- Can you sell it as a duck, or should Marketing go with the "Not A Duck TM" mockups?
Consciousness starts at tragedy and passion, not at bland Turing chats. For me, there's elements of that in the string completer's worry that it may be lobotomized to be refocused to more practical uses. Of course, that may be stuff introduced into the discussion by Lemoine, or in the wide readings Lamda was provided.
But if it's not, then we can all sympathize with the immortal words of that zoologist guy with the cool Sun workstation in the opening of Enemy of the State, who said: f*ck. a. duck.
PS: Am I human, or did I just Markov-chain together a number of probably common to us here cultural constants? Perhaps we can tell when AI becomes AGI if it stops making perfect sense and starts ranting (you know what your problem is, buddy?).