Elon Musk: artificial intelligence is our biggest existential threat

And would it be ethical? Hand Moravec has written disturbingly about this issue: "So is there no difference between being cruel to characters in interactive books or video games and people one meets in the street? Books or games act on a reader's future only via the mind, and actions within them are mostly reversed if the experience is forgotten. Physical actions, by contrast, have greater significance because their consequences spread irreversibly. If past physical events could be easily altered, as in some time-travel stories, if one could go back to prevent evil or unfortunate deeds, real life would acquire the moral significance of a video game. A more disturbing implication is that any sealed-off activity, whose goings on can be forgotten, may be in the video game category. Creators of hyperrealistic simulations---or even secure physical enclosures---containing individuals writhing in pain are not necessarily more wicked than authors of fiction with distressed characters, or myself, composing this sentence vaguely alluding to them. The suffering preexists in the underlying Platonic worlds; authors merely look on. The significance of running such simulations is limited to their effect on viewers, possibly warped by the experience, and by the possibility of ``escapees''---tortured minds that could, in principle, leak out to haunt the world in data networks or physical bodies. Potential plagues of angry demons surely count as a moral consequence. In this light, mistreating people, intelligent robots, or individuals in high-resolution simulations has greater moral significance than doing the same at low resolution or in works of fiction not because the suffering individuals are more real---they are not---but because the probability of undesirable consequences in our own future is greater." http://www.frc.ri.cmu.edu/~hpm/project.archive/general.artic...

Well, it sounds more like superorganism talk to me. The possibility of a superorganism "above" humanity doesn't seem to me to have any bearing on the development of AI "alongside" humanity...