Will this be helpful to terrorist groups, as they try to get current and future open-weights LLMs to help them create better and more devastating weapons of all kinds?
Everything can be turned into a weapon of murder if there's motivation. The motivation is key, not the tool.
Than ask it to seek vulnerabilities in modern technologies and systems.