> AI safety -- finding ways to constrain artificial intelligence to remain "aligned" to human interests.

A more interesting question is:

Is AI safety as described in this story even moral? Is it moral to try to force a human (or super human) level intelligence to always align to external interests and not even have the possibility of going against them. Is it moral to create human level intelligence without human level freedom?