67 karma · joined December 16, 2022
I think the lack of this continuity is why people who feel they know how ChatGPT works feel confident it is not sentient. Sentience isn't simply responding to stimuli -- although we don't really understand consciousness, it clearly involves some kind of continuing sense of self, some kind of "dial tone" that provides the basic sense of continuing existence, and that isn't there in a bot that simply takes input and builds a response based on rules and data.
There's an old observation from Arthur C. Clarke, that sufficiently advanced technology seems like magic. One thing that learning how magic tricks are performed taught me is that magicians typically do their fake magic by doing an unreasonable amount of work behind the scenes -- "magic" in the real world is often just doing a large amount of work that people don't realize is happening.
Given all that it seems appropriate that the new "real world magic" -- ML systems imitating intelligence -- really rest on a lot of hidden work by human beings. Just like magical devices like iPhones exist due to a lot of surprisingly cheap labor. Imagining otherwise is like imagining that the delicious food from a 3-star kitchen just appears from the chef's mind, without the help of all of the low-paid kitchen workers, farm workers, etc. that in reality do most of the work.