Hacker News Reader

Humans aren’t freely choosing what they want either, not sure how you can expect it from machines.

The point isn’t that humans are perfectly free — it’s that we occasionally notice when something is moving us from the outside, and can choose to resist it. That meta-awareness of being moved is already a different class than optimization under fixed rules. A(t) begins there — not at perfect freedom, but at noticing the frame itself.

This is crank.

People keep saying they want AGI, but do we really want technology we can’t control? The reality of that isn’t something I think people will ever want. Human history is full of humans controlling everything around them. We don’t like things we can’t control.

If we don’t like it, will we be willing to pull the plug if the economic value is measured in billions or trillions?

Posted by f_of_t