Nobody seems to care much, and we proceed to fulfil the destiny of our technological enslavement 'because it's going to happen anyway.'
I've been thinking about that but in terms of famous actors. Once AI can replace actors in movies, as well as singers and models like Instagram influencers and so on, maybe some of the weird hero worship and the paparazzi and the gossip mags and all that nastiness will fade away somewhat. That, I feel, would be a good thing. Pick your favorite Hollywood actor, or pop singer. A supremely talented human... Amongst thousands and thousands of supremely talented humans in their field and yet they are the ones who got lucky, had the right connections or got lucky with the right role. Then for the rest of their lives they are feted and hero worshipped as if they are more than human, while thousands of equally talented people who didn't get the lucky break are ignored. That's what being famous is, mostly, and it's not good for either the famous people or the people who worship them.
Does that apply to scientists and authors? I'm not sure. But in terms of scientific breakthroughs it's extremely rare that a particular discovery could only have been made by one person. In fact, nearly every discovery, from the calculus to the theory of evolution to DNA, was concurrently discovered by multiple people. And yet we attach one name to each discovery and hero worship that person because they published a few weeks earlier or were just better at self marketing.
Maybe losing the attachment of famous names to things is a good thing for society. As long as it's not replaced by a corporation pretending ownership of all the knowledge in their place, at least.
AI does not do novel things, it will only work with the information it is fed.
If we had AI overlords they would be able to do novel things because they would be able to generate new information on their own.
I dunno, I remember seeing on youtube Hatsune Miku concerts being pretty packed, and there was that one guy who even married Hatsune Miku. Who knows what'll happen with AI.
Just ask who came up with this stuff. Learning material doesn't go over the long history of the science involved either.