There's a difference. You can drag someone out of their house without consent, but forcing a transfer requires consent. Does this difference matter?
If you’re worried about the government forcing you out of your home at gunpoint, what makes you think they can’t seize a private key or force a few keystrokes?
Again, you’re seriously arguing that it’s harder for the government to take your house rather than give up your password?