Ex-Google CEO urges US to ignore calls to ban autonomous weapons
thenextweb.com
thenextweb.com
Why not...just not? And see what happens? We're all guaranteed to die anyway, so what is there to lose? It's not rational to bet on the end of the world in any possible situation.
I'm having similar thoughts a lot recently, which are far from original to me, yet I am disturbed by all the people who apparently don't have them.
Like, the richest guy in the world cares about union busting and tax breaks at the moment, but why? I literally can't imagine anything he can gain from being a bastard at this point, and so I can't even get viscerally angry. It's more like contemplating the mysteries of a tornado. What the hell makes it go and what would stop it?
And as far as I know, autonomous weapons don't inherently involve scorched earth scenarios. Perhaps in the far future the worst war we have will be each side attacking the other's autonomous weapons and then calling a ceasefire because humans are too costly to be in the frontlines.
Think of it through the lens of an iterated prisoner's dilemma: if I suddenly develop deathbots and you don't have them, it changes the payoffs for defection/cooperation which could cause me to change strategies and kill you.
I would recommend Axelrod's book "The Evolution of Cooperation" for ideas surrounding this.
With the above information, what would you do, if you were a state actor of an advanced country? Surely, (1) you either want to develop these yourself, or (2) ensure that nobody else develops them. (2) can be achieved by international treaties, but the question is whether it can be enforced. If state actors don't trust option (2), then the only option left is (1).
Because the consequence being the end of the world rather than just a large part of it is what keeps the peace.
Perhaps you meant dispassionate?
Expressing this quality in a single word is a challenge.
At the very least weapons are controllable; they have a kill switch. Things like SARS-Cov-2 do not have a kill switch.
Because as I see it the primary domains where these weapons seem to excel is drone-warfare, border control, surveillance and so on, not necessarily national defense.
These technologies seem more like a backdoor to eliminate human ethical concerns from decision-making and empower domestic policing (which is where military technology tends to go), rather than defending the country. What's a concrete example where, even when China or Russia do not honor a ban, the US could not simply strike with a human in the loop?
Democratic societies who value human rights already forego the use of countless of military tactics they could potentially employ. It hasn't made any of them defenseless.
https://www.forbes.com/sites/pauliddon/2021/03/25/the-last-a...
I'm against taking the human out of the loop and leaving the decision and responsibility to kill to a machine. I can think of many situations where a drone is a necessary technology to win a war but of far fewer where a human confirmation cannot be afforded.
That aside, if China or Russia gets AI robot guns it’s gonna be like boomers playing against kids with aimbot in counter strike. The US will get destroyed.
Drones are assumed to be remote controlled, therefore retain a human decision maker at all times. Robots would make such decisions themselves.
While drones come with their own set of problems (usual suspects are transparency, deployment regulations, sovereignty, decision making without skin in the game, etc.) they are distinct from the set of problems robots / "autonomous" weapons introduce. (Like distinction, proportionality, transparency & responsibility)
The actual title provides key context.
While it's completely pragmatic to pursue autonomous weapons due to peer competition, I wonder if it will paradoxically erode US warfighting edge when effective algorithms becomes ubiquitous. Why Arab Lose Wars -> Will Arabs Lose Wars. Incompetent forces previously limited by poor institutions and traditions that would otherwise take generations to cultivate can be improved closer to global parity by importing competent murder bots. Wonder how monkey models of exported AI weapons will have functions limited.
>Provided their use is authorized by a human commander or operator
https://static.wikia.nocookie.net/simpsons/images/d/da/Dimes...
I remember various people writing about the ebbs and flows of centralized oppressive government and attributing it to the type of weapon that's prevalent and the support system it requires. George Orwell writing just after WWII was very apprehensive about more than just the atomic bomb per se, but by the idea that the best weapons available would be only available through massive industrial projects of the largest governments and therefore all the greatest despotisms would be able to survive indefinitely.
Your comment also reminds me of reading somewhere a long time ago how the US having a decent phone system left it with a lot of copper infrastructure that held things back, whereas some countries that have been much poorer in the past went directly to cellular - thus in general wealth implies early adoption and possibly too much investment in immature tech.
>too much investment in immature tech
Or research into paradigms shifting tech negates moat of old advantages. Russians good at antiair because US would not want to invent tech that would erode US air supremacy. Kind of how UK lost naval gap due to dreadnaught reset. I can imagine AI air planes undermining US air / naval superiority balance. Lots of obsolete hardware and training if a fleet of drones become smart enough to penetrate a carrier group. Perhaps it may even be sensible not to pursue / start arms race if it means undermining decades of expensive acquisitions and expertise. Or at least have enough security to ensure adversaries don't acquire kryptonite of your own making.
It's unfortunate that this puts us on a possible path to self-replicating AI war bots and an endless war between two robot armies with nobody left alive at the helm, but the alternative is asking people to leave themselves vulnerable to invasion and subjugation, which simply won't fly.
" We have come to visit you in peace, with good will."
―Klaatu upon arriving to EarthIs there a possibility we could be having it all wrong? The potential to assume non-confrontation instead of environmental risk?
With our current programming, I guess not.