You're wrong about BTC transactions happening on physical paper with no connection to the network. It's not possible.
Edit: Additionally, as someone else pointed out, you could have kept your own copy of the key and could empty the wallet before me.
I did say -technically- and I do mean that - I’m not suggesting this is practical.