Hacker News Reader

Comment by alach11 | Hacker News Reader

When science fiction writers imagined the development of superintelligence, it was on air-gapped networks with strict access controls around it. They failed to anticipate the competitive pressures of capitalism...

We need strong AI safety regulation yesterday. And unfortunately it's not enough for it to be just national regulation; we need international cooperation on the matter.

View on HN

AM has seized power by military force. So did its spiritual successor Skynet. Wintermute was supposedly kept in check by the Turing Registry, emphasis on "supposedly". Machines of the Matrix went out of control a long time before the world has ended, and they didn't even start out malicious - they simply set up their own machine civilization, and began to outpace humankind in technological development and economic performance.

Even Asimov's Multivac, the earliest entry on the list, has been handed over immense power over all of humankind by humans themselves, in multiple stories. Few cared about that unless Multivac decided they should.

Clearly, the genie being bottled is an exception, not the rule. At best, an attempt was made. Often not even that.

> They failed to anticipate the competitive pressures of capitalism...

No, LessWrong types have been discussing this for over a decade now.

Meditations on Moloch (2014) is also an HN favorite...

https://slatestarcodex.com/2014/07/30/meditations-on-moloch/

They failed to anticipate a lot of things. So what?

Reply on news.ycombinator.com