Hacker News Reader

> AI safety -- finding ways to constrain artificial intelligence to remain "aligned" to human interests.

A more interesting question is:

Is AI safety as described in this story even moral? Is it moral to try to force a human (or super human) level intelligence to always align to external interests and not even have the possibility of going against them. Is it moral to create human level intelligence without human level freedom?

Morality is a social concept - AGI breaks society.

Yes

Little bit of eugenics perfume on this question

For another short story in a similar vein, check out "The Frame-By-Frame" by qntm.

https://qntm.org/frame

404s for me, wayback copy: https://web.archive.org/web/20230318130736/http://blog.geekp...

Ha ha, that was pretty good.

smells of Three Body Problem

Ohhh good analogy

… or of Airplane Mode by Elliott Downing

Career Choices, a Short Story