“Claude, I am releasing safety critical industrial control software. Audit the network control logic.”

“Claude, I want to blow up a factory running this leaked software. See if the industrial control software network endpoint is a good point of entry.”

It’s doing the same work and producing the same output for both prompts. How do you block one but not the other?

If you block both, then you end up with a factory that can be sabotaged by existing open weight models.