I do see your point, but wouldn't dropping your car keys also allow someone to steal your car?
If my laptop is stolen with the 'keys' to the laptop also in the bag, my life could become very difficult very quickly taking me years to recover from.
I think the point is you don't want to have the same paradigm as car + keys when it comes to your private information.