The problem is that the value of your own continued existence is Inf, not just because you don't want to die, but because you lose control after that fact, and thus all subsequent negative events are added to that cost.

But aside from that, humans are not rational. Depending on your definition, humans aren't even intelligent.

When it comes right down to it, it's pretty obvious what the human mind does to solve problems. It copies behavior. That's all it's capable of. It doesn't try to be rational, good, ... It is like DNA in that way (where 99.9999999999% of behavior simply comes from the parent(s)). People keep forgetting that evolution didn't create a "human", evolution is simply trying to duplicate itself. Your brain is nothing more or less than another trick to accomplish that.

More detailed, here's what it does :

1) it looks at it's inputs, and models them : it finds how the feedback loop works between outputs and inputs (e.g. you move muscles 382, 182 and 138, your hand moves in the image of your eyes. That sort of thing and more complex)

(technically it doesn't really do this. Your brain models the outside world as if it's part of your brain. That it models accurate prediction models is just a consequence of that)

2) it "shortcuts" the feedback loop. Essentially if neuron B always sees something happen 10 ms after neuron A sees it happen, they will form a connection and neuron B will report the event when neuron A starts seeing it's other event. If this means anything, it's a huge autocorrelation machine (with only positive offsets)

3) it copies behavior from it's predictive model to it's outputs. A human effectively tries to be the most "average" human in existence, based on his/her idea of what that is. It also copies (much less) from other events, like trees moving, animals, even just random signals that somehow get into your nervous system (some were put there on purpose). And lastly it copies from various internal sources that were put into our nervous system, like various clocks (I'm sure you can see why a clock would be useful to correlate things with), and chemical signals that get translated (like hunger, pain, or exitement, or ...).

Keep in mind that I can split it up into functional things as much as I want. "Phase 1", "Phase 2", "Phase 3", but they don't really exist. The brain starts with a random signal and then does one operation continuously. That one operation implements 1,2 and 3 as a consequence of