Yes, modern cards are basically YubiKeys. You can't trust people (such as bank employees) to maintain private keys. That would never work.
Maybe some kind of USB/Bluetooth device that can authorize your physical debit card can let online merchants debit bank accounts securely. I know they have had something similar in the UK for decades.