It was meant to be rhetorical. The answer is no, you can't. Same with ML. Training on copyrighted material? Just fine. Producing and distributing material that infringes on copyright? Not allowed.

It's no different than a photocopier or a VCR when you're using it for that purpose, it's the end result that matters.