I might sound a little bit 'tinfoil hat' here, but I believe that what follows is not hyperbole. AI is already the 'Architect' more than most of us would like to admit. Even if it is not sentient, the various AIs that we use during the day were designed with a purpose and they are goal oriented. It is worth reading Daniel Dennet's thoughs about the intentional stance--we know that a toaster is not sentient, but it was designed with a purpose and we know when it is or is not achieving that purpose. That is why we might sometimes jokingly say that the toaster is 'angry with us' or that when the toaster dings that it is happy. It is actually easier for us humans to interact with objects when we know that they have a purpose, because that is similar to interacting with other humans who we know to have purposes.

Coming back around to AI, ChatGPT was designed with a purpose, and people project intent onto it. People act like it is an agent. And that is all that matters. The same is true of the Tiktok AI, the AI that calculates your credit score, the traffic lights by your house. Hell, it's also true of your stomach.

The point is that objects in our environment do not have to be literally conscious for us to treat them as conscious beings and for them to fundamentally shape the way that we live and that we interact with our environment. This is pretty much the basic tenet of cybernetics. To believe that all of these tools do not have intention and that they are 'just tools' used by some people to influence other people is not wrong, but I don't think that it captures the richness of the story.

Differentiating where humanity/consciousness begins and where the technology ends is already more complicated than most people think. Traffic lights train us just as much as we make traffic lights. I fully believe that people will be saying "this isn't true AI, it doesn't /really/ have feelings" long after the technology that we create is so deeply embedded into our sensory I/O that the argument will be moot.