Ok, that seems ridiculous and infeasible and nothing that has happened so far indicates that this is a real threat.
>Yes, but it would be so catastrophic to humanity, that we must take it seriously, regardless of how improbable it is!
This is the AGI debate, in my view. If we're picking different extremely improbable events to get worked up about, why stop at AI?
My point is that the only thing that seems to convince the pro-AGI crowd is having them make specific predictions, waiting until the deadline, then asking them why they didn't happen yet.
I'm not sure what you would do now that is different because you are anticipating such a thing.
Actually the video addresses this point, the comparison it makes is waiting until we’re already on Mars before we start thinking about spacesuits and airlocks
This is just another in a long line of technology panics. Unfortunately, there always seems to be some "concerned" experts that are both overly optimistic about the speed of technological progress and overly pessimistic about where that progress will lead adding fuel to the fire.
Eventually some other new technology will incite a new panic and this one will become another footnote in history like the fears over grey goo or genetically engineered superhumans.
[1]: You might disagree with this assessment, but my point is that this is not where most people are arguing from.
The parts and models are off the shelf now, it just needs the first person desperate enough to release a swarm of killcopters with cheap ML classifiers to make it a reality.
Curious how people will feel after the first autonomous swarm becomes widely known, because it will be replicated widely.