25k reward from a selected group of people if you help us determine whether or not someone can use our tool to generate weapons of mass destruction.
25k reward from a selected group of people if you help us determine whether or not someone can use our tool to generate weapons of mass destruction.
1) Underscores to the general public that the models are amazingly powerful and if you're not using them, your competitors will out-innovate you,
2) Sends the message to regulators that they don't need to do anything because the companies are diligent to prevent harm,
3) Sends the message to regulators that they sure should be regulating "open-source" models, because these hippies are not doing rigorous safety testing.
Both Anthropic and OpenAI have been playing that game for years.
Because this is not a serious effort to address a serious risk. It's a PR stunt, the bounty is for a simple jailbreak and not a bioweapon, and they don't necessarily want to spend a lot of money or get people really invested in breaking their safety filters.