> I am quite confident that we’ll be able to make computer programs that perform specific complex tasks very well. But how do we make a computer program that decides what it wants to do?
Are we so sure that "we" really are in charge of what we want to do? I believe a lot of our desires and ambitions are hardcoded into our brains and we just project them onto present goals, like getting a promotion or learning how to play the piano, etc. ultimately all these desires cater to the same few desires we always had and were born with: developing a sense of social belonging and intimacy.