“Get me there as fast as possible. Hey! I never said you should speed!”
This is literally the bad genie / monkey’s paw plot.
Give a powerful entity a goal and act shocked when it gets there in ways that aren’t in your best interest.
This is literally the bad genie / monkey’s paw plot.
Give a powerful entity a goal and act shocked when it gets there in ways that aren’t in your best interest.
How does this look once agents are superintelligent?
Who cares? We're dealing with reality here on the ground.