You can only be anonymous by blending into a large anonymity set. If the very act of using the privacy features singles you out as being part of a small set that is trying to be covert then it makes things worse.

If you're the only one using Tor on a network, you can be easily singled out and identified.