The problem is that SSN's are treated like a private key. If somebody has that private key, and some basic information about you, they can basically impersonate you electronically.
Meanwhile countries like Estonia use an electronic card reader with a PIN to verify digital identity, making it nearly impossible for somebody to impersonate you. Using this Estonian system, you can tell anybody your personal code ID.