What is intelligent life? Portia Spiders and GPT
aeon.co
aeon.co
And even current societies concepts of male/female. In Children of Time the Portia Spiders are Female dominant, and eat the males. Scale that up to an intelligent society and it was pretty interesting perspective change to see female characters debating if they should go hunt some males for dinner. And later discussing 'rights' and "of course males can't be equal, can't they just be happy if we let them live.."
(I vaguely remember something like this happening with a monster's POV section in Schlock Mercenary, but that's a long web comic and I can't remember when in it's history to look for).
It switches POV here: https://www.schlockmercenary.com/2001-10-22
I've always found the term AGI confusing. For example, how general does it need to be to qualify and what specific cognitive capabilities does it need to exhibit? My gut feeling has always been that it's not a helpful guiding star for AI research.
It seems better to be led by the problems we want to solve as that makes it easier to define success and generality is still beneficial since you can more efficiently solve more problems with general solutions. What this essay solidified for me is that what we call intelligence is really just a set of tools that allow us (humans) to solve a certain collection of problems. We mistakenly believe all those tools are cognitive, but really some are just evolved responses and instincts.
The thought experiment goes thus:
Assume it's possible to simulate a conscious brain with a deterministic program. (Already a big ask for some, but this is one of the axioms of my argument so bear with me.) Assume that if embodied the simulation would be indistinguishable from the original person, but also if not embodied it could be interacted with in a simulated environment.
If it is deterministic, that means if you re-ran the simulation with same data , inputs, and timing, all would proceed identically. Is the simulation conscious again while replaying it along a fixed path?
Suppose you memoized portions of the computation. How much of the brain could you memoize before you no longer consider it conscious?
Suppose you could, instead of memoizing "in breadth", instead use memoization to skip steps of the consciousness without changing the outcome. How many in-between states could you gloss over while still considering the simulation conscious?
Suppose you divided the simulation among multiple computers, without changing the outcome. If you accept the original premise, you may have little trouble accepting a distributed system with a fast network is also capable of hosting a conscious mind. However as we said this replay is deterministic, there's nothing stopping nodes from substituting internal playback of pre-recorded network packets for actually communicating on the network.
Are you prepared to call it a simulation of consciousness if a "distributed system" of nodes each internally simulating all of it, in portions, while all remaining silent and not sending any network packets between them?
My point with all of these variations is not to say which is or isn't conscious, it's to argue there is no clear dividing line. One could come up with moral arguments about which of these scenarios it's unethical to keep trapped in this experimental setup versus which are the mere image of a thing and not the thing itself, but that's my point: it's only a moral/ethical dilemma and not a physical or informational state change between non-conscious and conscious. The "universe doesn't care;" consciousness is not a conserved property.
I think this is touching on the 'philosophical zombie' arguments.
If something is crated like a robot/ai, that is completely indistinguishable from a human, is that thing even possible without having some inner subjective experience? It seems like people fall into two camps, if it is a machine, then of course it is a zombie, no inner life. The second camp that says the machine is conscious. The problem is from outside, you can't really prove it either way because the premise is that it is indistinguishable.
So, I think in your example, it is interesting extrapolation, the 'invention' is indistinguishable and deterministic, now what if we split it up, compress it, etc.. when would that inner experience go? or would it end at some point?
Of course, if a consciousness could be played back and forth like this, then that would be argument for GPT to have some consciousness .
As well as Buridan's ass: https://en.wikipedia.org/wiki/Buridan%27s_ass