Yep, dead wrong. If you hand someone a private key, you now both have control of those coins.