We're going to live in that world forever now, capable adversarial models have already been trained and will be used in a large conflict.
The pragmatic issue is hacking, and current open-weight LLMs are already capable of it. Bioweapons and RSI are pie-in-the-sky theories that distract from the real-world situation that each government wants to exploit.
It wasn't long ago when automated hacking was a pie-in-the-sky theory.
Sometimes it's helpful to prepare for things in advance. An ounce of prevention can be worth a pound of cure.
> An ounce of prevention can be worth a pound of cure.
It can be, but if you get chemotherapy on a hunch instead of a diagnosis then it could kill you instead. There is no evidence that RSI will ever exist.
So we wait until it's actively happening to do anything about it?
Red mercury and RSI are both science fiction psyops. They do not exist.