AFAIK, using copyrighted data to train does not necessarily make the trained model "toxic". "Authors Guild, Inc. v. Google, Inc." case [1] is viewed as a key precedent for this view.
[1] https://en.wikipedia.org/wiki/Authors_Guild,_Inc._v._Google,....