Even if the money is used completely legitimately it will be exchanged for goods and services thus ending up in someone's pocket. Someone who may want to buy Bitcoin.