(Or perhaps vulns that NSA/etc discovered and has been keeping it private; as they're known to do).
I feel there's a lot that's unaccounted for, and the whole "AWS team reports a 'jailbreak' that is just 'review this codebase'" story doesn't add up.
I wonder if there were some parallel construction going on, and if at the same time, the NSA started losing the exploits they had because it was getting patched.
While there is some fallout likely with much more effective hacking being easily accessible, I’m sure govt analysts (unless they were let go) have their own prediction models telling them it’s inevitable that this technology eventually makes it to everyone they don’t want having it, what with China seemingly releasing every progress they make openly. Which makes me think that they’re preparing for that inevitability by hardening the govt systems currently in place and/or by burying the secrets they want to keep hidden deeper underground.
Given the history of the US and this particular administration, I feel burying things deeper is a greater priority.
-t. American
A government staffed by logical, sane people would have figured out how not to encourage this, like mobilizing the IT and security industries to secure their products faster, while also cracking down on the "our AI is the most dangerous tool in the world" rhetoric bandied about by the frontier companies. But we don't have that, we have a government of Loony Tunes characters. When you put extremists in office you get extremist behavior.
Model prep costs far too much money to operate under this kind of regulatory regime.