I don't think that scenario actually works. Reason: the superficial, "sounds like a person" AI's don't actually have what it takes to sustain a huge, high-tech society.
OTOH, letting the idle rich "move" to the matrix could be a good thing...
OTOH, letting the idle rich "move" to the matrix could be a good thing...
Unless you don't believe that such an AI is possible, in which case I wonder if you have tried GPT-4 and whether you remember what chat bots were like 5 years ago!
This of course would be AGI. It would still not be conscious though, but a lot of people would fall victim to it and believe that it is. And that's what will end us. We will not pass the mirror test (yep, this one https://en.wikipedia.org/wiki/Mirror_test)
But in the real world - those same descriptive words are written by a Marketing Dept. The actual engineers, who developed and built the AI, on an all-too-finite budget, know otherwise. And know that the PHB's already have plans to cut the production cost - by collecting data on which parts of the already-limited "mimic all human activity" are ignored by the AI's actual customers, and quietly nerfing or removing those parts.