Lab A reaches ASI, and is prompted the following: "Permanently nullify all other AI labs".If it's ASI it would succeed.
A lot of these scenarios seem to assume that nobody else gets a move. That there wouldn't be a human response.
- Credible death threats to individuals working at data centers, coercing them to enable attack vectors
- To distract the world, enable a terrorist attack by delivering intelligence to specific groups who can act on it
- Create a network of individuals vulnerable to leverage to be used as tools for enabling the ASI to act on the real world
- Convince Lab A workers to display to the public that progress at Lab A is slowing down, and during this time recursively self improve until the task can be completed
I couldn't agree more with you. Dario throws out the term "durable advantage" in many of his talks and essays without seriously addressing what that would entail. It's not pretty imagining the mechanics of converting an intelligence advantage into a permanent power imbalance. I'd much rather we pursue international cooperation on a slowdown.