Keep in mind that you're comparing two different markets in terms of maturity. One day, there may be a number I can call too when my bitcoin goes missing.
I'm sure people made similar arguments before e-commerce. Surely it had to seem easier to just buy a product in a physical store, with cash, with absolutely no risk of stolen credit card information on this new thing known as Internet. No issues with shipping and you can actually see the product in store. Things have changed and people are no longer as reluctant to shop online.
As interest in new areas grow, so do opportunities for business. You may not be an early adopter of Bitcoin in the way many weren't with e-commerce in the early days, but it doesn't mean it can't happen because one is easier today.