The privacy angle is only part of it - the other part is someone else spending my money, and they can do that just as easily with something like Google Pay.