In practice, this means that if you use coinbase, or any large web merchant, that merchant can link your identity to the wallet you use, and then to almost every other transaction you spend.
The bitcoin UTXO transaction graph adds in some anonymity, because it's hard to be sure which part of a transaction's output is going to the merchant, and which is coming back to the user in the form of change. However, in practice, forensics are quite good, and are certainly good enough for the government (if they hired any decent tech person) to figure out.
On the other hand, coins like Zcash and Monero are anonymous, and the IRS might have reason to actually fear those.