No, you use a stolen private key to transfer the Bitcoins to a new public key whose private key is only known to the thief.