Hacker News Reader

Comment by barbudorojo | Hacker News Reader

"We need a scalable intelligence without the burden of emotions"

I believe that there isn't an absolute way to value a human life if you don't take into account emotions.

If intelligence is the supreme of the values that one can use to justify actions then AI will make the machine the sovereign of our planet. The real problem is giving a sense to our existence and actions in a way compatible with our emotions and nature and at the same time based on a sound ground. For a machine without emotions our life is no more valuable of that of any other thing be it alive or not.

View on HN

I want to ask if someone has any idea of how to define a system that is both logical and respects the value human life. Today we can see children dying from hunger and other people with billions in their bank accounts. Emotions tell us this is not a just system, our rational legal system tell us we must respect the law and the status quo. But how do you design a better system?

Take a look at this: https://intelligence.org/files/CEV.pdf

But also, what in particular makes you think that experiencing human emotions are fundamentally required in order to optimize for human values?

A different mind might have different emotions, or it might have no emotions, since emotions are a kludge that came about by natural selection, and may not be optimal safeguards in ensuring that an intelligence acts to optimize for the values we want.

I think that perhaps none has stopped to consider what is a life without emotions. In the same way that one can't grasp the concept of nothing, for us the concept of not having emotions is impossible to imagine. Perhaps you make hide your emotion in a rationalization but the emotions are there perhaps are the source of your thinking, the fountain of your ideas and vitality.

I am going to read the 38 pages of the Yudkowsky paper you link to, but for starter using the word Friendliness to describe the research for a safety IA that is not going to convert human in slaves is a comical term that don't reflect the risks involved and try to water down the problem.

I think we should think outside of the (human) box. We needed emotion, I don't think machines do. Well, the machines we will build will have emotions as we cannot socialize with them otherwise, but a problem-solving AI does not need any of that.

Reply on news.ycombinator.com