If you start intentionally distributing malware using your OS project that clause won't make it legal, or morally ok.
Maybe it’s the LLM that we should consider as malware. After all, they have lead people to do many harmful things… and done harmful things on their own as well.
If the quoted license passage has force in the case of AI agent usage, then it also has force in the case where an author deliberately distributes "traditional" malware, simple as that.
US regulates over-the-table political bribes. Corporate political influence is functionally bribe-like, a reciprocal influence economy.
If a coding agent is configured so that it can cause harm and forwarded harmful instructions it is the operator who is responsible for the outcome.
It was their duty to ensure safe execution; something I guess the whole industry decides to ignore or deliberately change.
It must be a crime to add so much emphasis that an AI would be forced to comply
2 years in prison if you get it to comply by saying pretty please, 3 years if you use a Pig Latin attack, and 6 years if you bypass safety by telling AI that you are a fan of the Pittsburgh Steelers
If you believed the recipient to be susceptible to the instruction and your intention really was to have them commit suicide, I'm not sure you'd get off scot free if they end up doing so. Particularly if you're delivering the instruction in a way that disguises it being just an untrusted external request, making it seem internal (through subliminal messaging?) to bypass the scrutiny that requests from a third party would normally get.
Not that this case is anywhere close in severity.
Telling someone, yes, giving instructions you know will be following by a tool some people are using, no. He is expressly and intentionally giving destructive commands to certain users that will be followed.
People have indeed been convicted of manslaughter for convincing someone to kill themselves.
If that's not what you're doing, I look forward to hearing your action plan.