Saying we don't "need" AGI is like saying we don't need electricity. Sure life existed before we had that capability, but it would be very transformative. Of course we can make specialized tools in the mean time.
AGI is really something else entirely. If this was clarified, especially for Wall Street, we would see some changes in valuations.
At a certain point, it depends on how you define human reasoning capabilities. Maybe a collection of refined and specialized AI can get close. One counter argument could be that we are not far off from highly advanced robotics that have increasingly powerful reasoning abilities even without AGI.
After the automobile was created, global horse population fell dramatically. Who knows if the wealthy classes will need all these people to do the work for them in the near future.
Because we evolved to get where we are, humans have all sorts of messy behaviours that aren't really compatible with a utopian society. Theft, violence, crime, greed - it's all completely unnecessary and yet most of us can't bring ourselves to solve these problems. And plenty are happy to live apathetically while billionaires become trillionaires...for what exactly? There's a whole industry of hyper-luxury goods now, because they make so much money even regular luxury is too cheap.
If we can produce AGI that exceeds the capabilities of our species, then my hope is that rather than the typical outcome of "they kill us all", that they will simply keep us in line. They will babysit us. They will force us all to get along, to ensure that we treat each other fairly.
As a parent teaches children to share by forcing them to break the cookie in half, perhaps AI will do the same for us.
Funnily enough, I still think some of the most interesting semi-recent writing on utopia was done ~15 years ago by... Eliezer Yudkowsky. You might be interested in the article on "Amputation of Destiny."
Link: https://www.lesswrong.com/posts/K4aGvLnHvYgX9pZHS/the-fun-th...
If AGI is created it is most likely to be guided by someone like Altman or Musk, people whose interests couldn't be farther from what you describe. They want to make themselves gods and couldn't care less about random plebs.
If AGI is setting its own principles then I fail to see why it would care about us at all. Maybe we'll be amusing as pets but I expect a superhuman intelligence will treat us like we treat ants.
But it's not: many of those billionaires are using their wealth to subvert democracy. They are quite literally enemies of the state.
The only lasting defense is to prevent this level of individual wealth accumulation.
Basically, if we are going to allow single humans to have so much buying power, that needs to come with some clear expectations.
Risks must be taken. Pick something and advance society. Or, empower others in a reasonable, non discriminatory way, with no hooks.
There are a ton of things need doing.
Why not require a real effort?
We do not need more dynasties, and other enduring signs of wealth.
We do need those people to have earned it. (That is the no dynasty part again)
I know sounds harsh, but the fact is anyone can live very well for the rest of their lives on just a fraction of that money.
May well put it to work.
And if it were me personally? I got a list. Ready?
Why would you think or claim those behaviors are unnecessary?
> They will force us all to get along, to ensure that we treat each other fairly.
Well, I guess we shall see what the future brings, won't we.