Ridiculous hypothetical for analogy purposes, but, imagine if Anthropic had developed a new type of rifle that the military was considering using, which had a black-box AI system that could prevent the trigger being pulled when aimed at certain targets. The military says, ok that's cool, as long as we can be in control of that decision-making process. Anthropic says, no, we know better than you and better than the law what kind of targets should and should not be shot with our rifles. The military would then respond “lol, lmao even” and then deem them to be a supply chain risk and adopt another rifle instead.