I guess I don't consider this a legit argument. You could point to negative externalities that are the result of literally everything humans produce/consume.

But if we want to use that metric, OK. I would venture a guess that the production of coffee yields a heck of a lot less suffering than the production of cocaine, heroin or meth. Any far fewer people consume the latter.