being able to train a model to produce that shit implies a lot of input
So we should discuss it as an ethical problem because it's going to become practical and affordable far sooner than most people think. I would bet money it's already been tried and maybe done successfully, but for obvious reasons not advertised.
(This is legal in some countries, at least.)