Hacker News Reader

> You'd want to avoid abuse

Why?

What you're describing is a post-scarcity world. In that context, what does "abuse" even mean?

It's not post-scarcity, it's post-labor. Which is a prerequisite for post-scarcity, but not sufficient. Resources, even allocated optimally by a superintelligence, are still constrained based on the number of people living and the material contained on Earth.

(And, to be clear: I'm sharing their perspective, not mine).

Okay, but in that case "avoiding abuse" is no longer a problem for humans to solve, which is probably good in that it frees up time to try to figure out what to do when the paperclip maximizer no longer demurs from numbering hemoglobin molecules among its accessible resources.

There’s a spectrum of possibilities. What if GPT-10 obviates 80% of jobs and can’t automatically identify every human uniquely? This covers that step in the process.

AGI does not necessarily mean a post-scarcity world right away. You could have AI doing all jobs and doing them better than humans would, but still using finite resources and producing finite products.

I'm not convinced that manufacturing on the scale required for a post-human-labor world to be possible doesn't imply post-scarcity.

Reply on news.ycombinator.com