You couldn't have.

You might have had a person you know have your number in their address book uploaded to Facebook.