Hacker News Reader

Comment by ubercore | Hacker News Reader

The usable amount of AI, no matter how optimistic you are about current progression, has to be below the projections the entire AI economy is living on right now.

View on HN

Looking at the actual job I'm leveraging software to do, we've progressed past the point where I can do everything I want to do in-house on my own hardware. The bottlenecks in my processes are now human, procedural, and there for a reason.

It feels like the AI economy is being propped up by the idea that we're right around the corner from a fabled C-suite promised land where "labor" is unnecessary, but we've already been there for like a year now if you don't need a machine to explain your own business model to you, and it's basically free.

A considerable group of people think AGI or even ASI is right around the corner

Sure, just as a considerable group of alchemists believed the recipe for gold was right around the corner

technically we can turn lead into gold now though it's not economical or scalable. so the alchemist were proven right in the end.

> so the alchemist were proven right in the end.

Except for the fact that it wasn't right around the corner???

Coincidence, it is the same group trying to sell "AI" startup/services.

Modern AI is not an intelligence. Wonder what crap they are calling AGI.

Remove the people with horses in the race and your "considerable" group becomes much much smaller.

I've never gotten a straight answer as to whether AGI is a good thing for humanity or the economy.

Real AGI would be alive and would be capable of art and music and suffering and community, of course. So there would really be no more need for humans except to shovel the coal (or bodies of other humans) into the furnace that power the Truly Valuable members is society, the superintelligent AIs, which all other aspects of our society will be structured towards serving.

Real AGI might realistically decide to go to war with us if we've leaned anything from current LLMs and their penchant for blackmail

That's all been thought of, yeah.

No, AGI isn't a good thing. We should expect it to go badly, because there are so many ways it could be catastrophic. Bad outcomes might even be the default without intervention. We have virtually no idea how to drive good outcomes of AGI.

AGI isn't being pursued because it will be good, it's being pursued because it is believed to be more-or-less inevitable, and everyone wants to be the one holding the reins for the best odds of survival and/or being crowned god-emperor (this is pretty obviously sam altman's angle for example)

Is it believed to be inevitable, or are their careers just dependent on that being the case at all costs.

Those seem the same to me

it is believed by some to be inevitable, yes.

Best case scenario for ASI is that they create enormous wealth and will keep humans around as pets because it costs essentially nothing, like in the Culture series by Ian Banks or The Polity series Neal Asher.

Humans are extremely costly in terms of the resources we need in order to survive, the space we take up, and the messes we make (everything from the shit and piss we generate to the wars/destruction/death/violence we inflict on pretty much everything around us). We'd make for entertaining pets, but we're the farthest thing from low maintenance. Even ignoring that all other animals on earth share many of the problems we'd impose on our owners we stand alone in having done devastating amounts of damage (some irreversible) to ourselves and our planet.

I'd hope that they'd keep a few of us around, but it's hard to see the logic in them keeping all of us and allowing us the freedom to live and breed the way we do right now.

"Humans are extremely costly in terms of the resources we need in order to survive"

No. With the kind of wealth ASI can generate keeping 10 billion humans alive with a very good standard of living is like a human owning a cat.

Don't a considerable group of people think the rapture is right around the corner?

https://www.pewresearch.org/short-reads/2022/12/08/about-fou...

Always.

A surprisingly sticky belief when taught young enough. Anxiety about having been left behind every time you come home to an empty house is just a bonus.

Thankfully education about physics, first principles, and critical thinking got me out from under it. Hopefully they can do the same for the rest--if we get them young enough.

If it was that close I think they would have made well over half their money back by now . . .

You've got to figure that the mega-capitalists have so much more discretionary accumulated resources relative to government than ever.

Other than government, is there anybody else who can loosen the purse strings a little bit and have it not act as a temporary stimulant as long as it lasts?

Whether they wish it would last or even provide any benefit to the average person, seems like there are plenty who wouldn't wish more prosperity on anyone who doesn't already have it :\

The only real way for long-term growth would be to plant seeds rather than dispense mere artificial stimulants.

Unless AI makes the general public way more than capitalists have spent, it wouldn't be worth any increase in cost whatsoever for things like energy or hardware. Even non-AI software could become unaffordable if their labor costs go up enough too keep top people from being poached by AI companies flush with cash.

I bet even the real estate near the data centers gets more unaffordable, at the same time clocking a win for the local economy due to the increased cash flow and tax revenue. Except all that additional cash is flowing out of peoples' pockets not in :\

Reply on news.ycombinator.com