All LLM's are capable of producing really vile completions if prompted correctly -- after all, there's a lot of vile content in the training data. OpenAI does a lot of work fine tuning them to steer them away from it. It's just as easy to fine tune them to produce more.

In fact, there was an interesting paper showed that fine tuning an LLM to produce malicious code (ie: with just malicious code examples in response to questions, no other prompts), causes it to produce more "evil" results in completely unrelated tasks. So it's going to be hard for Musk to cherry pick particular "evil" responses in fine tuning without slanting everything it does in that direction.