Bitcoin provides anonymity in the way that it doesn't anchor its addresses with your real life identity.
Yes, the addresses are public, but there isn't a way to prove who's who according to addresses alone.
Unless of course you publicly attach your identity to one.