It's easy to reconcile your beliefs: "Privacy is good when it's for me, and bad when it's for other people".
Privacy and anonymity in all forms can both benefit and be abused, which is why there's usually some sort of balance. Bitcoin doesn't attempt to find any balance, which is too bad.