Maybe in the far, far future when we have androids which can house an AI we will have to worry. But designing a body is one problem. Designing an intelligence is another.
Maybe in the far, far future when we have androids which can house an AI we will have to worry. But designing a body is one problem. Designing an intelligence is another.
Also superintelligence doesn't need a body itself. It just needs yours. Putin for example has commanded hundreds of thousands of dumbasses to go get themselves killed in Ukraine. In this case does it matter if Putin is flesh and blood, or a processor that lists out commands for others to follow as long as they are willing to listen?
But this replication must follow the physical laws we have. It must also follow the laws we attempt to enforce in our networks.
But you are correct, if a superintelligence were to somehow convince a human to rid itself of agency, sure.
Hey bro... do you want some...MONEY!
It doesn't take much.