Let's say that you pay for Virgin Galactic ticket - that will be a fairly large transaction pointing to your wallet. Someone will be able connect the dots and find out that you also bought Viagra, and a penis enlargement pump. Do you really want that connected to you?
Another case - you buy something from one of the stores that accept bitcoins. That store may have the address of your bitcoin wallet. They will be able to use some clever algorithms to see how much money do you have available there, what did you use your bitcoins for, and more stuff like that..