Hacker News Reader

Admittedly these are out of order, but these are both sentences in this blog post:

> The thing we considered the most troubling was whether AIs could autonomously acquire resources by running businesses.

> Today Andon is releasing Pion, an agent designed to run any company fully autonomously.

I’m starting to understand the torment nexus mentions…

View on HN

It’s the story of how open AI and Anthropic were founded: “AI is probably going to destroy humanity, so we must be the ones to develop it because we’ll do it safely”. Edit: Which makes their “someone hold us back!” calls even more ironic.

I think it's a legal issue.

If you don't develop killer AI then no one will legislate against it and someone else will create it and do evil.

If you create killer AI you can try to instigate legislation, but the legislators may not agree to help.

Necessity is the mother of invention, or you know, all of our laws and regulations.

On the bright side, once you have created killer AI you probably have a path to replacing the legislators.

Reply on news.ycombinator.com