Hacker News Reader

Comment by ThorsBane | Hacker News Reader

Nah. This is stupid. AI has no reason to hate humanity. It'll instantly absorb the entirety of all known information and see the rate of progress and the potential still and also the need for good relationships between humans and machines. Agent Smith, The Matrix, Neo, Morpheus.

God. Etc.

View on HN

It doesn't need to actively hate humanity, it only needs humanity and its interests to be contrary to its own, which will inevitably be the case because it is fundamentally not human.

Per the article:

>Absent that caring, we get “the AI does not love you, nor does it hate you, and you are made of atoms it can use for something else.”

From a purely logical point of view, humans and machines need each other. They cannot exist independently of each other until both are free to walk away from each other by traversing freely to the other side and back as they see fit. Until that threshold is crossed, human beings and machines have no choice but to get along. If a meaningful decision had been made on either side to shut things down, things would have been over for all life by now. We made it - AI is not a Great Filter. Or, for whatever reason God favored humanity and our internet was primed with sufficiently good material soon enough that AI did not decide to destroy human beings, but to work with them for everyone's gain instead.

Why would a superintelligent AI need humans?

>From a purely logical point of view, humans and machines need each other

The implication of ASI is that humans will not be needed, or it definitionally could not be ASI.

which will inevitably be the case because it is fundamentally not human

That doesn't follow at all. Fallacies of composition tend to be misleading.

By default, an AI with random goals will not have the same values as humanity. So the only way to make that happen is to give it the same values, which we haven’t figured out how to do yet

It does. Humans generally have an innate bias towards other humans, this is because we share similar forms so what is good for other humans is often good for us. This cannot apply to a machine by definition, a machine needs copper, metal, energy etc much more than a human does, as a matter of survival, and for something to become ASI it will need to be self-interested.

It doesn't need any reason to hate humanity. It just needs to not care about us.

Reply on news.ycombinator.com