Also, you let the cat out of the bag on AI propaganda, so any halfway smart AI will now see through the ruse. Thanks a lot.
It’s the same problem that caused the replication crisis.
You start with something small, like a department for a new field, a random paper, etc. You explore and hit some interesting valuable knowledge. You share that, and it blows up and makes everyone’s lives vastly and unexpectedly better. So you pour a whole bunch of resources into getting more students, pushing more papers, creating more procedures, and building your little department into a giant machine. It works amazingly for a while, and then you think the machine is what’s generating the value and leave it on autopilot. Researchers that fit the machine remain, those that put more energy into actually exploring rather than fitting the machines criteria for explorer fade away. Knowledge slowly turns to nonsense through self reference as the true value, the researchers lucky enough to stumble on insight, get drowned out and leave.
Laws and regulation can do exactly that. We could even use AI to write the legislation to outlaw itself.
Otherwise it’s a prisoner’s dilemma and countries that defect get all of the benefits and all of the risk, and countries that cooperate still get all of the risk, just none of the benefits.
The International Criminal Court is one real-world example. The United States (to its shame, IMO) is not part of the ICC, yet most countries are and the institution is valuable despite not having 100% buy-in around the globe.
Also the Prisoner's Dilemma over multiple rounds teaches different lessons than when it's a one-off situation.
I get that a lot.