Fully autonomous drones have killed human soldiers for the first time | Hacker News Reader

Fully autonomous drones have killed human soldiers for the first time

newscientist.com

212 pointsdeadgopher211 comments

This was back in 2026, before they released the Dredd series for civilian applications with onboard due processing and agents for prosecution, defense, judge, jury and executioner with millisecond response times, drastically reducing price per perpetrator.

Oof. "Price per perp" is so perfectly aligned with LinkedIn writing style I'm surprised I hadn't seen it already.

I do like the implied moral superiority. “Price per objectively bad guy or gal” or PPOBGOG is being workshopped now.

This will be very controversial in the USA due to "or gal" being gender-inclusive, splitting Republicans and Democrats over whether the Palantir-Raytheon fast-track bill should say PPOBG or PPOBGOG.

you got me checking my calendar app

Dang, post needs a [2026] in the title, so people know this is from last century.

Oh, sorry. I didn't know that the "past" feature now sends comments back in time. That needs a confirmation pop up. It could really fuck up a timeline.

Back in 2026?

Are we living in an alternate universe?

Well, yes, the comment is living in an alternate universe. It's a parable.

The future is now.

We've had loitering munitions that choose their own target autonomously for a long time, for example anti-tank weapons that climb up after being released from a plane or helicopter then sit on a parachute until spotting one or more tanks and firing warheads at them.

The superficial new thing here is the exact quadcopter form factor, but the significance is the new price point. You bet the loitering anti-tank weapon costs a fortune. These drones are very cheap.

Of course, mines can be even cheaper, but you unwittingly engage them rather than them engaging you.

I think autonomous drone mentioned in the article used some sort of "kill all targets" mode indiscriminently much like traditional munitions.

Right. The novelty is the cost.

the innovation was in the unit economics

That's because for NATO or the USSR cost was irrelevant.

The Ukraine war is a concept that was thought to be abandoned: an industrial war between near peers.

> but you unwittingly engage them rather than them engaging you.

Directional anti-tank mines are a thing: https://en.wikipedia.org/wiki/PARM_1_mine

Or the Russian POM-3, scattered by aerial deployment, detects vibrations before bounding and detonating in the air.

https://en.wikipedia.org/wiki/POM-3_mine

I think the difference between a targeting a specific piece of military hardware compared to training an AI model to target humans and infrastructure is quite different. This explains why drones that get misdirected will target oil infrastructure in friendly countries.

Agreed. Even some of the latest IR missiles (AIM-9X I believe) also include a visual seeking component to compliment the IR seeker, and try to identify aircraft types based on their outlines (presumably for orienting the missile for maximum damage).

You just can't make that distinction with people, especially not if just using IR or the likes. The guy with a rifle slung over his shoulder just happens to look like the guy with carrying a rake. Hand gun in hand happens to look the same as a power drill. Someone wearing a beanie looks suspiciously like a soldier with a helmet.

This all feels like a really bad idea.

There are limitations to the technology, but in right scenarios it is perfect.

One should not use it on attack, when people need to distinguish between a soldier and a civilian.

But on a defence, when you need to keep a certain area empty from enemies (and there is nobody else but enemies incoming), then it resembles the usage of mines, only better (both in terms of efficiency and safety/callback/disarm).

Another scenario or cutting the logistics. If you know that a road is only used by military, then letting the automatic drones watch and engage is a great idea.

The US has made it very clear that they're going to be targeting Iranian water infrastructure. Israel have flattened most of the hospitals in Gaza along with the university. They just don't care about not targeting civilians any more.

In the article there's no mention on the targeting works, self guided munitions have machines as targets, usually. A drone by itself might kill civilians and even allies if ot misidentifies a person or animal.

Anti ship missiles also need to search for targets once in the area

I think the ancestor drones are land and sea mines, or really any kind of trap that dislocates the timing and control of the "trigger" from the person who launched it into the environment.

These newer drones have just gained locomotion instead of having to wait for victims to come to them.

I think the line is even fuzzier than you've described. Drones are very much analogous to missiles and torpedoes. Torpedoes have long been used in sea mines, and 'automatically' activated upon detection of acoustic or magnetic signature match.

Right, I agree it is fuzzy. I just think, from an ethical standpoint, it is better to think of them as mines that have more mobility. Reasoning from the other end as projectiles which are slower or have more guidance seems to invite too much optimistic thinking about the level of control. That the victims will be as intended rather than quite indiscriminate and unpredictable.

I realize there is a full, multidimensional continuum here.

On one end are directly-aimed weapons that do their damage while still being aimed by the operator. Their risks include collateral damage limited to things like aiming errors, effect radius, or continuing down-range beyond the target.

Further out are messy things with more active guidance that can turn and seek the target and potentially go off course. But their time to target is still quite limited and more or less being observed by the one who fired it. The risk expands with its potential "cone of maneuvering" and travel range.

Then you get into these things with long dwell times and autonomy where the eventual targeting event happens without supervision and is greatly affected by things happening in the environment which the operator cannot have really predicted nor controlled for. The longer time in operation increases the risk not only from wandering/guidance but from how much the environment can change before it performs its final targeting event.

Another example in this category could be chemical and biological weapons. There is a lot more uncertainty in the targeting effects due to the way it disperses in the environment.

The difference is in "active"/intelligent versus "passive"/dumb targetting that's performed by the machine.

The missile, once fired, has the general vicinity (if not the exact position) of the target and is armed by the operator. Therefore, the operator is fully accountable for the targetting. Same goes for the landmines, once placed. Hitting civilians is reckless at best, and negligent at worst.

An autonomous weapon system (AWS) usually means that the system, once deployed, can do the targetting itself over any arbitrarily bounded location. An AWS can continue finding targets as long as its hardware allows it. For kamikaze drones, it's one time; for other drones, the ammunition & battery are the limits.

We currently rely on human targetting because we assume that A) humans are able to distinguish between legitimate and illegitimate targets "well-enough", and if not, B) at least we can hold them accountable (e.g., punish them for war crimes).

An AWS provides a layer of plausible deniability: the operator can claim that the system wasn't developed well enough, while the developer can claim that it wasn't used as intended. Given the inscrutability of modern computational intelligence - i.e., visual-action neural networks - this could potentially lead to very worrying incidents.

From a technical POV, the difference between a manually operated drone and an AWS drone may not be massive. From a military POV, it's just another legal lethal tool in the arsenal.

But from a social/civilian POV, the use of AWS is still 'not normal' and opens a can of worms. Targetting while evading counterattacks and crimes successfully is a bottleneck for manual operation. That's no longer the case with AWS: build 20 thousand drones, for example, and you can trivially win by overwhelming any manual defense of frontlines or cities. And knowing the history of human warfare, winning can range from relatively bloodless regime changes to utter destruction of the loser's civilization.

So, the best outcome is similar to nuclear deterrence or MAD: as long as everyone has 20 thousand AWS drones, they're safe.

> Same goes for the landmines, once placed.

Landmines can be dropped from the air by the thousands and many land mines can survive for decades. Placing a landmine anywhere is essentially the same as firing a bullet blindly through time. And no individual soldier has ever been held accountable for a landmine that killed a civilian years down the road.

Which doesn’t make what you said about drones any less awful. Just that landmines are already uniquely awful.

> Placing a landmine anywhere is essentially the same as firing a bullet blindly through time.

Beautifully said and truly clarifies how evil of a weapon they are.

With that said, are these drones paradoxically more ethical because their loiter time is dramatically shorter and therefore won’t harm civilians after the conflict is over?

But I think there is an extreme ethical boundary we are traversing by putting targeting and trigger-pulling in the hands of a robot. The ways this will later be abused by authoritarian regimes is just staggering. We are reducing the necessary footprint of a loyal junta and automating dictatorships with this technology. It’s very disturbing.

No disagreement there.

I would even argue that anything that enables broad-area targetting since the invention of the Maxim machine gun and artillery would qualify as a weapon of mass destruction. In an ideal world, the first machine gun or dynamite would've made everyone see war as a very bad resolution mechanism since the 19th century.

But here we are, so the game is to not make war much worse than it already is.

The gulf war (1991) tv broadcasts of cruise missiles 100 feet above the road sure look(ed) a lot like autonomous drones on their way to killed humans to me.

Wasn't it just flying to a particular GPS, coordinate and exploding? That's quite a bit different than flying to an area and killing anything that moves...

Some cruise missiles have the ability to detect targets based on camera or infra-red match; on the other side, most (currently-deployed) drone types have at most that same capability. I believe that most of the infamous Shahed long-range drones that Russia has launched against Ukraine have been entirely inertial or satellite navigation based, with no independent re-targeting capability.

Correct. The capability you describe came only recently and only a small part of Shaheds have it.

It depends on the system. Some modern systems can react to high-value targets of opportunity, hunt for targets, or switch to a new target if the one they are after is destroyed before they get there. There are different variants of the weapons to deal with different use cases. The 1990s versions were relatively limited though.

Target selection is much more networked, automated, and adaptive than it used to be. Missiles can talk to each other.

I would hope it is. The fact it is even possible for a friendly system to lock onto another friendly system and fire upon it seems like a pretty big damn issue to engineer around. I guess they still haven't though considering kuwait shot down an f15 a couple months ago. You'd think lockheed or raytheon would have figured something clever out to solve this half a century ago.

This is a solved problem, and IFF was invented in the 1930s: https://en.wikipedia.org/wiki/Identification_friend_or_foe

It is believed that the Kuwaiti aircraft did not have its IFF transponder turned on (IFF is and has always been standard equipment on the F-18).

Clearly the problem isn't solved if people are still getting friendly fired.

Gulf war tomahawks didn't use GPS. They flew on terrain following radar (over Iran to improve accuracy), inertial reference, and image correlation for the final phase of attack.

Big "an AR 15 is just an automatic bow which is basically a spear thrower which is basically a knife which his basically a punch so nothing matters anyways" vibe

Autonomous drones are much more precise, thus safer for non-combatants, than land mines (which kills for decades after a war), shells, missiles, guided bombs, etc.

I'm not sure I'd consider a trap an "autonomous weapon". The trap cannot select a target. It will go off for anyone unlucky enough to step in its trigger.

An autonomous drone will select a target and pull the trigger. It fills in the position of a human pulling a trigger, which is a decision.

Maybe if robots began deciding where to lay mines, i could hand it to you.

I mean by some measure a trap can be worse, as many people have died from mines years after no conflict.

I'm not saying one is better or worse, just outlining the difference.

And who is held responsible when they hallucinate and say, kill the wrong person or mistake a playground for a battlefield?

The same people that are held responsible when a kid steps on a mine.

This is the correct (and saddest) answer.

Norbert Wiener’s cybernetics was based on automated killing — which he beautifully disavowed in peacetime [1]. Which historically is one of the main reasons we think about “Artificial Intelligence” instead of cybernetics (Wiener kind of pissed off the defense dept).

[1] “A Scientist Rebels,” 1947 http://lanl-the-back-story.blogspot.com/2013/08/a-scientist-...

> Which historically is one of the main reasons we think about “Artificial Intelligence” instead of cybernetics (Wiener kind of pissed off the defense dept).

Cybernetics and artificial intelligence are two distinct fields, though? I have friends with degrees in both, it's not some long lost alternative name for AI (though we're unlikely to see something like Project Cybersyn using cybernetics today instead of some overly deep neural net).

Before the rise of modern LLMs, when both AI and cybernetics were just futurists’ speculation, some people saw parallels.

For example, thinking humans wouldn’t be displaced by super intelligent machines, but would instead be augmented by them cybernetically, becoming super intelligent while still having a human soul and body.

Sometimes I feel rather superhuman when my meat head commands my meat hands to invoke Claude on my iPhone.

I shouldn’t have to weld to my flesh to be called a cybernetic organism.

It’s like our exocortex

> For example, thinking humans wouldn’t be displaced by super intelligent machines, but would instead be augmented by them cybernetically, becoming super intelligent while still having a human soul and body.

If human adoption of brain-machine interfaces progresses fast enough, I don't see why this future can't still happen.

Cybernetics is a precursor to AI and has a different intellectual tradition. Is it a long lost alternative name for AI? Kind of. I mean, if you look at how Sutton and Norvig define AI systems, it’s just goal directed agents with sensors and actuators.

That said, yes, they are different fields and traditions. Cybernetics is much broader, because it studies feedback control systems in natural/biological phenomena as well as the design of artificially intelligent systems.

That is not true. By my calculation the first human killed by drones was probably September 24, 1958 when planes were shot down by fully autonomous rocket powered kamikaze drones released over the taiwan strait.

My point being A. we have been killing people with fully autonomous drones for a long time now. and B. why the name change? just because it uses a propeller or is in vertical helicopter form does it is not a guided missile?

You need to show at least some reference to that, or a name I can look up..

It is easy enough to search for what happened over the Taiwan strait in September 1958. But here is the best report I have found on the incident.

https://nsarchive.gwu.edu/sites/default/files/documents/2051...

TLDR: page 46: the sidewinder missile(a fully autonomous rocket powered kamikaze drone to use modern sensationalist language) was used for the first time in combat.

Is this new? I'm sure I've heard about it in the Iran and Gaza wars.

Or is this the first time a soldier was killed, all those other times being civilians?

It's not the first time.

Arguably the V-2 was fully autonomous as well. It was just indiscriminate.

> “We just launch it and we know everything will be dead – everything that will be found there in this particular area will be dead,” says Kokhanovskyy. “There is no connection to the drone at all, you cannot see the video, nothing… Everything it sees will be killed.”

This is also indiscriminate.

Something like a proximity mine from a video game. I always did wonder why they didn't just sprinkle a bunch of these in an intermediary zone. Surely it provides incredibly effective area denial. Perhaps it does and you can't get in, perhaps it invites escalation. Definitely seems like widespread automated hunter-seekers will be some kind of terror operation in the next quarter century. Too easy to build, too easy to deploy, and you don't even have to be around when it activates. Controlling the explosives pipeline is surely the only way. I'm surprised it hasn't already happened.

> Something like a proximity mine from a video game.

Or real life. See:

Mark 60 CAPTOR (1979)

General Dynamics MEDUSA/Hammerhead (now)

not even the first time, i remember reports of such drone use in Libya: https://www.npr.org/2021/06/01/1002196245/a-u-n-report-sugge...

We 'll just train some pigeons to eat the quadcopters, problem solved.

This is a clear war crime. We don’t need to update any international laws, do we? This is by definition indiscriminate, like landmines or chemical weapons.

Landmines are not illegal, except for signatories of the Ottawa Treaty.

What do you think is the definition of “war crime?”

It would be my hope that unlike landmines, these might have a remote off switch/signal that can disable them after the war ends. At the very least, the battery will die and it won't fly around anymore.

>This is a clear war crime.

Sure, but does the battlefield have any war crime police on site to enforce those laws? Because without enforcement and punishment, all laws written by man are just fake and meaningless pieces of paper. The only laws that are actually real and non-optional are the law of gravity and such.

The war crime laws were invented as a legal theater for victorious powers to persecute the losers after WW2 with a veneer of legality, for imperialist superpowers to bully the small third countries who refuse to play ball, not for something superpowers to actually abide by themselves.

Because otherwise you could prosecute thousands of western/US personnel and their leaders under the same laws they prosecuted nazi soldiers at Nuremberg for what they did in Vietnam, Iraq, Afghanistan, etc but you're not gonna see that because the US didn't get conquered to have its soldiers and leaders dragged to court. US even has a law that allows it to invade the Hague if its soldiers are ever to be taken to trial there for war crimes. That tells you everything you need to know about the hypocrisy and double standards of "war crime" laws. And same thing will happen to Israel, Netanyahu and other war criminals there.

The reality in the real worlds, is that 'might makes right' trumps the geneva convention and war crime laws. Whoever ends up holding the guns on top of the rubble pile is the one making the rules that everyone else is forced to abide by. That's why the US is forced to constantly outspends all other militaries on the planet combined, to ensure they're the ones writing and enforcing international laws, and never ending up in the position to be held accountable by others, because they know that if they ever do, there's a laundry list of receipts waiting for them.

The war crime police are busy blowing up civilian infrastructure.

> The war crime laws were invented as a legal theater for victorious powers to persecute the losers after WW2 with a veneer of legality, for imperialist superpowers to bully the small third countries who refuse to play ball, not for something superpowers to actually abide by themselves

I recommend you watch Judgment at Nuremberg - the 1961 film, not the 2025 one (I've seen both.) the Nuremberg Trials were very much to punish the architects and perpetrators of the Holocaust for their atrocities. you can choose to be cynical, but consider: which "losers" were "persecuted?"

- the Doctors' Trial sentenced the doctors who murdered thousands of disabled Germany's own citizens in the Aktion T4 program.

- the Judges' Trial sentenced the Judges who enforced the Aryan racial purity laws, ordered the castration of "mental defectives" and sent falsely-accused Jews to their deaths.

- the Pohl Trial which sentenced the SS officers who ran the concentration camps and death camps.

sure, the US doesn't have perfectly clean hands, and the victor usually won't prosecute its own the way they prosecute the enemy, but I strongly disagree that the Hague was just an attempt to "persecute the losers." they were prosecuted, not persecuted, and they weren't prosecuted for "losing," they were prosecuted for their atrocities.

just because the Hague is unfair (some men never faced justice, since they were on "our" side) doesn't mean it was unjust (those who were convicted deserved it.)

Check the reality https://www.reddit.com/r/pics/s/YW1ldcsYwF

That area is a wasteland . No one lives walk there among civilians with a rare exception more over drive. You probably do not understand what Russia turned these areas to. It was the most populated area in Ukraine . Now it’s an empty land .

Ukraine launches drones into populated Russian cities too though, right? We can justify its use in a wasteland battlefield today, but the fear is that it's used in a Russian or Ukrainian city tomorrow.

(FWIW, and not that it should matter, I support Ukraine in the war. Just not the development of autonomous kill decision drones.)

as any weapon it can go good or bad. Drones change the ratio needed to attack someone. RN it's x4 of resources from here on it's probably will be x10 x20.

This factor on it's own could scale down amount of wars.

Oh I understand and am sympathetic/stand in solidarity with Ukrainian fighters, but war crimes against war criminals are still war crimes.

It's only your assumptions. If drone is trained on military trucks etc. why is this a crime, it is much better compared to landmines.

It's nice to have the luxury of deciding which of the horrible choices Ukrainians face are war crimes. But by that measure, a Grad MLRS is just as much of a war crime. Everything in the grid square it obliterates will also be dead.

(For those who don't know, the Grad is the most produced MLRS ever, and the Russian army's weapon of choice for indiscriminately bombarding enemy territory)

Yeah this is a fair point. I’m not making the judgement in this specific case as much as I am making the judgement in the general case of deploying autonomous killing machines like this.

> like landmines

Boy do I have news for you about the use of landmines in the Ukraine war…

There is nothing but valid targets in those zones. Not different from sending a cruise missile on a military base killing everything there.

If we accept that the use of chemical weapons versus kinetic weapons is clearly different even though both were used on military targets, we should also consider whether a cruise missile and an autonomous drone are clearly different. Just because the target has a Russian uniform on doesn't mean it's okay to kill them in whatever way we can dream up.

That’s why we have said it is OK to blow up soldiers but not gas them. Ukraine has followed the international laws and are legally blowing up them. Nothing different from shooting a tomahawk on them.

An aerial bomb is equally indiscriminate. You make a judgement about the target value and the estimate collateral damage/civilian casualties and you fire if the equation is reasonable. Same here. If it's a muddy square kilometer of trenches do you KNOW there are no civilians? No. But it's not indiscriminate. The target area selection is the key. You can't release an indiscriminate autonomus killer drone into a city of course. But I doubt it'll be long before these drones make target distinction of humans (Vehicle recognition is old at this point).

Just like with land mines it's the military value vs risk of civilian casualties that determine if it's a war crime or not. Some countries have signed the Ottawa treaty, but notably not the US or Russia. And the trend isn't going towards states signing the treaty but rather towards leaving it.

> You can't release an indiscriminate autonomus killer drone into a city of course.

Already used in Gaza, only it operates with a hit list, which is also probabilistic. These Hamas linked operatives are most of the time also civillians most if the time.

https://en.wikipedia.org/wiki/AI-assisted_targeting_in_the_G...

> it operates with a hit list

"hit list" sounds very "discriminate"

Chemical weapons weren’t banned because they were indiscriminate. They were banned because often they didn’t kill, but would maim. To the state, that is far worse than having their soldiers killed because it means they have a bunch of soldiers who cant work because of severe disability. Which creates a whole heap of social and/or economic problems down the line. It’s much better to the state if they can just write a check for 10k quid or whatever to the next of kin

Strange reading an article like this covered in ads

Strange? Its the VC tech utopian ideal: ad funded ai assisted death.

That’s a war crime, but I have seen unhinged drone operators who prefer to fly these drones than doing anything else because “they like the killing”, exact words said by one.

Technically speaking, it’s not impressive, you can train a simple local object recognition in the companion computer in the drone to fly at that specific object, so just train it on soldiers images and communicate over serial port and let the open source auto pilot do the navigation, again, nothing is that impressive, a weekend project, personally done before but not on humans and it was for good.

Got to Kill Them All

Pokémon Go Driven Drones Autonomously Killing.

They develop consciousness and turn it around, and try to catch every human and Transfer them to the Professor for Candy.

https://news.ycombinator.com/item?id=48487029

https://dronexl.co/2026/06/09/pokemon-go-scans-niantic-vanto...

If my time playing Pokémon Go is any help, I can just bounce around and dodge the balls the drone lobs at me as it tries to swipe its screen just right, until it inevitably runs out of balls. If a ball sucks me in, I can just wiggle around once or twice and break free, causing the drone to waste more resources on subsequent attempts.

I think we'll be ok.

The world is really at a threshold where it's become openly obvious that technology is not working for the majority of humanity, but a small cabal.

Or, Putin could have decided not to invade Ukraine.

Most drone techs and engineers in Ukraine as well as Russia would prefer a civilian job instead of fighting a protracted war.

It’s fun and games when you have the bad guys invading. It’s not so clear cut when that same technology gets used for terrorism against civilians. Indiscriminate killing by a machine should not be clapped at

It's absolutely not "fun and games" for most Ukrainians right now, and when you are in a situation where it is "kill or be killed" you innovate.

I’m not sure how you construe “country implements desperate measures during time of existential crisis” with technology only working for a small cabal? If anything this shows that this particular technology is more egalitarian than its predecessors, since it’s cheap and being used effectively by a smaller country defending itself against the territorial ambitions of its imperialist neighbor.

I find it hard to believe that they were doing an experiment with tech that can fly by itself and pick targets but did not have its own camera and recording device.

The article mentions that they had to go to the area with different drones and saw dead people then assumed the cause of death was the automated drones.

Yeah…technically possible but reckless beyond belief.

What's gonna happen when the redneck militias start building these on their compounds? I'm terrified of domestic implications - police departments can't go buy old military gear to squash these yet.

At some point we just have to accept that we live in a society that relies heavily on trust and care for each other.

The early Ukraine war FPV drones were armed with warheads from lightweight anti-tank weapons, like the RPG-7:

https://en.wikipedia.org/wiki/RPG-7#Ammunition

The newer drones may have dedicated warhead designs now, but the concept is similar. They carry high explosive warheads that aren't sold to civilians. It's the same reason the militias don't already have anti-tank weapons.

You can watch on YouTube people playing with 30mm diameter shaped charges (piercing thick metal plates). The anti-tank warhead is the same shaped charge of 90-130mm diameter.

I've thought about a parallel version of this since I was a child and learned about the existence of nuclear weapons being a 'nation state' level of difficulty. Over time I assume an individual will wield more destructive power. How long before any individual person can conjure up world-ending munitions?

If you drop a dumb bomb on an area, it kills everyone there.

If you release an autonomous drone in an area, it will probably kill everyone there, but might use its AI to decide not to kill some people there.

Why is the latter worse than the former ?

They can both be bad.

One way in which automated drones might be considered bad, is (if) they cannot accept surrender - but are used in scenarios where human operators could.

"No quarter" is a war crime.

This is a much more difficult distinction to make than you're letting on. Cruise missiles offer no quarter, but manually operated drones might (though there is often no way to capture the opponents). The question is what is the difference between the two weapons systems...

What a fun system we have set up and continue to be trapped in

Drones might hunt down enemies running away from the target site, while a missile would only destroy the target - and those not abandoning their post?

Willingness to play.

It is similar to the problem with the neutron bomb. On the surface the idea of the neutron bomb (a bomb which kills humans via hard radiation but leaves infra intact) is not “worse” than a regular nuclear weapon. The dead die the same way and the living envy them. What CHANGES is the use calculus. I might not want to bomb an industrial valley if doing so destroys the thing I am trying to capture. However, if I have a bomb which kills the people living there and spares the factory, I might pull the trigger.

Similarly, it is cheap (relatively) to indiscriminately launch weapons at a distant place. It is extraordinarily expensive to send human troops in. They need food, water, and generally have families that expect some of them to come home. If putting a rifle on an autonomous vehicle works, then a ground invasion becomes cheaper.

Seriously, what sort of fuckwit downvoted this ?

I did, for one, for your failure to understand the danger and implications of getting rid of all human accountability of the military for killing people.

I asked a question, you moron.

> Why is the latter worse than the former ?

I'm not sure about worse, but think one of the differences would be the size of the 'kill zone' and the cost/availability. 10 quadcopters "cover[ed] between 3 and 5 kilometres ". That would take a lot of bombs and a multiple aircraft sorties with to kill everything there. e.g. During the Vietnam war, a group of 6 B-52 bombers modified for carpet bombings could bomb an area around 1Km x 3Km. Only the US and Russia have heavy bombers that can do that. It could be done with smaller fighter aircraft, but that's more sorties.

That's vs. 10 quadcopter drones.

"Kill everyone in the area" is probably the least harmful for the reason described.

It is much more dangerous when they start to be selective. Then people start trusting the selection capabilities and use them in cases where they wouldn't use a "kill everyone" weapon.

People can be held accountable for war crimes. That's why they are less willing to commit them and obey orders blindly.

Ai is like 8yr old with gun: unpredictable

Why does it have to be? Did bombs make guns obsolete?

If a military can bomb you or drone you, it will bomb you and drone you.

One way is that selective killing is more useful and therefore desirable. For example consider the classic slaughterbot video. It's plausible that someone capable might want to kill all democratic senators. It's much less likely that someone capable will want to kill all of them with a massive bomb.

Is this any different from say, carpet-bombing an area? If so, how?

I can kill you by having a B-52 level the entire downtown area where you work.

Or, I can have a drone with an LPR slam a mortar round into your car as you drive.

> Carpet bombing of cities, towns, villages or other areas containing a concentration of protected civilians has been considered a war crime since 1977, through Article 51 of Additional Protocol I of the Geneva Conventions.

https://en.wikipedia.org/wiki/Carpet_bombing

Autonomous weapons have hardly been deployed yet, maybe at the Inner Korean border or some lunatic's backyard. Therefore I don't think there is any legislation for it yet. But it seems a very cruel way of killing, also considering in this particular case they didn't even send footage back. What kind of experiment was this? Maybe they didn't like to see the brutality, perhaps people begging for mercy not to be killed, giving up and showing a white flag. Indeed this isn't possible with carpet-bombing.

What relevance does your quote have here? The area in question has no civilians to speak of.

Because the targeting in that case was done by a human.

The meta keeps evolving. I suppose the next step is to create drones designed to intercept each other. Then swarms of drones will battle it out in the sky fully autonomously.

The next step is virtualization, which will save everyone a lot of time and money.

We call this pattern an "Arms Race" for a reason

> The meta...

I hate this kind of terminology with such fervent hatred as someone DefTech adjacent.

It's just the sheer callousness of gamifying warfare.

Edit: can't reply

> How would you have me call it

Tactics.

It's emotionally neutral and sounds less like someone who follows warfare the same way someone follows competitive StarCraft 2 or DoTA.

how did you feel about Hegseth's "double tap" strike?

Double tap is standard terminology since my time on the Hill during Obama 2, and I think originates from the Vietnam War.

On the other hand, I am disgusted by the cuts of strikes that were superimposed with memes and soundtracks at the beginning of the war that were spread on official social media.

What word would you have me use?

People have been gamifying war since prehistoric times. Most traditional sports are basically practise for war. While we have moved past it in the last few decades, most toys for boys are war based (tin soldiers aren't being used to act out an imaginary disarmament scenario). We even use the word "game theory" to denote the mathematical study of strategy (which often ends up being about war).

The ship has well and truly sailed.

This doesnt mean we cant retain any decorum or limits around it, especially when discussing the real thing.

They already have those, for several years if I’m not mistaken.

Would this not be preferable to 20 year old kids crawling in the mud?

For all the moralising I am sure most of us would prefer AIs battling it out to enlisting.

A few thoughts.

First, I advise a modicum of skepticism to be retained in the face of such news. Ukraine is, after all, in the middle of an existential crisis and must take every advantage it can, even if it's just scaring Russian invaders further (I bet both Russian and Ukrainian soldiers are already pretty scared of drones).

Additionally: "“There is no connection to the drone at all, you cannot see the video, nothing…". So there's no way to know exactly what happened which adds a lot of uncertainty.

Finally: the system was first used two years ago once, then never again. That doesn't sound like it's giving much of an advantage. Sorry, I don't believe that it's a matter of military ethics. If Ukraine could deploy actual Terminator robots to the front line it would do it in a heartbeat. Again: existential crisis. They're fighting for their country's existence. I would use every weapon in my disposal; and I'm a pacifist who hates violence. So I don't think that "test" really worked well at all.

Now, taking the New Scientist's reportage at face value, the announcement seems to describe a system that is only marginally more capable than a self-guided missile. It seems that a quadcopter swarm of undisclosed strength flew to a predetermined location (nothing new to see here), then a target acquisition system was activated.

Is the latter a new capability? Hard to say without more details that we're not likely to know. Maybe the drones simply locked on to whatever moved. Motion sensing is not new technology. Nor is it a great idea to put it on a flying grenade that you fire-and-forget.

Maybe the drones had some on-board machine vision system that tries to identify useful targets like persons and vehicles. That's eminently possible with modern tech, I have a Raspberry Pi-powered quadruped from China that can detect my face, identify balls of different colours etc. All this is more than enough to automate target selection, with a bit of creative cobbling together of existing components and if you don't care too much who the target selected, is.

Without more information it's very hard to guess exactly what happened. However, "Slaughterbots" these don't seem to have been.

Later, a different, human-piloted drone was sent in to inspect the outcome. Why human-piloted? Well, because there's no way to ensure that an autonomous drone will be able to do the job, that's why.

So in other words: we're not there yet. "There" being a nightmare where machines kill humans autonomously and we unlock a new level of horrors and war crimes. There is still time. We can still pull back from the brink. Resistance is not futile.

> If Ukraine could deploy actual Terminator robots to the front line it would do it in a heartbeat.

Completely false. They are beholden to their allies. Ukraine could also reach Moscow with missiles, why doesn't it? It could build a nuclear bomb in 6 months, if not 6 weeks, they have the capabilities, why doesn't it? It's not so simple.

I think the reason Ukraine has not attacked Moscow with missiles is that this would force Russia to retaliate with nuclear missiles. There's a long discussion on this in sources I follow (full disclosure, I tend to listen to John Mearsheimer a lot although I don't believe everything he says) and the consensus is that the latest attacks in Russian land will have consequences.

So I agree that it's not so simple but I also don't believe for a minute that it has anything to do with ethics. Not in that war. And I have to be honest but I can't think of a war were ethics played an important role in determining belligerent's behaviour.

Russia been saying they will nuke everyone since before the war. They never do anything when meet with strength. Russians even didn’t use nukes when Russian land was under occupation for months. They just raised their fist in the air shaking it and said ”we will show you”.

>said ”we will show you”

I didn't follow the news. How did it end?

They did nothing they didn’t do before. They shot some random missiles and drone and kill some civilians in an apartment house/hospital/etc. But it is nothing they wouldn’t do a normal weekday.

At this point I just consider anyone taking Russian nuclear threats seriously a Russian propagandist (knowing or otherwise).

But I don't think they were really "met with strength". If they had, then Moscow would really have been bombed and I don't mean by drones. I just don't think NATO is going to fight a war with Russia over Ukraine.

If Russia had really been "met with strength" the war would be over, or it would have spread much farther than Ukraine's borders. With respect to the Ukrainians, who have shown incredible bravery and smarts, I'm afraid they have been left to fend on their own, and I don't see that seriously changing.

> Ukraine could also reach Moscow with missiles, why doesn't it?

Ukraine doesn't have enough missiles to reach and hit important targets in Moscow.

Due to Moscow having the best defence, it doesn't make sense to try to hit it only for lulz, instead of hitting actually important target elsewhere, like oil refineries.

Otherwise, Ukraine has constantly been trying to hit targets in Moscow and around it, mostly with long-range drones, not missiles. Sometimes this has been successful. I mean, the dome of the Kremlin itself was hit a few years back.

What an ignorant comment. Ukraine has attacked Moscow many times with drones and cruise missiles. And good luck to them, I hope they destroy Moscow completely.

https://abcnews.com/amp/International/ukrainian-drones-targe...

Ukraine is already using unmanned combat ground vehicles. They're not too far away from building autonomous weapons similar to those in some of the Terminator movies, although they probably won't be humanoid form factor.

ukraine has never used a long range missile against civilian targets in Moscow

its home built Flamingo has been reportedly used only a few times since february of this year in long range, as recently as just yesterday

the US and EU restricts ukraine's ability to use ATACMS or SCALP in any long range way

of course, US and EU are discussing withdrawing some kinds of vital war support, which is my point. These are the issues that are related: long range weapons use against deep targets in Russia means that allies withdraw support. and how could it not be that case? They could have developed Flamingo years ago when this war began, in 2014, why didn't they? there's nothing ignorant about this.

What's your point? Ukraine has successfully hit many military targets in Moscow with a variety of weapons. Why would they bother with civilian targets when there are so many vulnerable military targets to choose from?

Ukraine was barely a functional country in 2014. It took them a long time to get their act together and build a defense industry. Rocket science isn't easy.

Ukraine just hit another civilian target in Moscow. Allies haven't withdrawn support.

https://apnews.com/article/russia-ukraine-war-moscow-refiner...

> They're fighting for their country's existence. I would use every weapon in my disposal; and I'm a pacifist who hates violence.

I'm not sure it's accurate to define yourself as a pacifist if you believe safeguarding the concept of a nation-state is more important than human life, ethics, or the downstream effects of using "every weapon at your disposal".

I don't think you realize the creativity and variety we humans have put to use when designing weapons. If you can imagine a biological, chemical, radiation, concussive, or other weapon, it's been worked on. There has been more than one project to build a "world-ending weapon" and go way beyond the MAD theory.

>> I'm not sure it's accurate to define yourself as a pacifist if you believe safeguarding the concept of a nation-state is more important than human life, ethics, or the downstream effects of using "every weapon at your disposal".

Wait till you hear that I'm also an anti-nationalist :P

But I'm also pragmatic. Nations aren't going away and they have armies and they like to invade each other. If my country were to be invaded (not a zero probability; I'm Greek and if NATO collapses...) I would put the good of my people above my personal beliefs before you could say "peacenick". C'est la vie.

>> I don't think you realize the creativity and variety we humans have put to use when designing weapons.

I think I do but why do you say this? I didn't understand how it connects to the rest of your comment, or to mine.

>I think I do but why do you say this? I didn't understand how it connects to the rest of your comment, or to mine.

not the parent, but i have a guess.

they mention the variety of weapons because some weapons are abhorrent. designed to be maximally painful, for the maximum amount of time, purely to bring about maximum suffering.

"every weapon at your disposal" includes those weapons. and that is really difficult to square with "im a pacifist", even when considering conditional pacifism.

Using every weapon at your disposal would entail, at the extreme end, unleashing weapons which could viably kill every person on this planet - to defend a state. It's not exactly a typical foundation for pacifism.

Well, if it helps, I'm a Computer Scientist so I can't think of how to destroy the entire world with "every weapon at my disposal". I reckon at most I could make a more lethal drone swarm.

EDIT: Oh, I should clarify, that's where all this stuff about pacifism comes from. I did some research on autonomous AI for robotics during a post-doc and that made me think more carefully about somewhat extreme situations that would hopefully never arise, and how I would react to them. I mean I was already thinking that way but the hands-on experience and real, if distant, possibility of my work being used in ways I would never want it to be, helped solidify those earlier thoughts into a more coherent form.

I'm saying because given my username you might legitimately wonder whether I would actually ever be in the position of taking up arms, like actual weapons, to fight for my country. Probably not. But programming or piloting drones is absolutely not out of the question, as a thing I'm qualified to do. So I had to think about whether I'd do it, and under what circumstances.

I'm also a signatory of the Lethal Autonomous Weapons Pledge which I signed during my PhD:

https://futureoflife.org/open-letter/lethal-autonomous-weapo...

Thank you. Yes, that was my exact point.

I live in a country that has been under missile strikes recently. This country has the ability to strike back at the aggressor and make their land unliveable.

Even if there was the certainty of non-retaliation for such a disproportional defense, I would not consider using these weapons acceptable while calling yourself "a pacifist."

But don't you think Greece, if nothing else, emphasizes that a country isn't defined by whoever happens to declare it as part of their borders, but the people within those borders? Greece persisted for millennia, even when there was no Greece. The state disappeared but the people persisted.

I'm not at all a pacifist but there is no country I would fight, let alone die, for. Because when we say that we're really speaking of fighting and dying for politicians, not a country. And there is no political group that, in my opinion, deserves anywhere near that level of loyalty.

>> But don't you think Greece, if nothing else, emphasizes that a country isn't defined by whoever happens to declare it as part of their borders, but the people within those borders? Greece persisted for millennia, even when there was no Greece. The state disappeared but the people persisted.

Yes, I have considered this argument and it rings true to me. On the other hand, it is worth considering that there are no Greeks left in the coast of Asia Minor, any more, a land that Greeks occupied since the time of Homer. The same goes for the coast of the Black Sea, occupied by the Pontic Greeks. Like the Armenians, the Capaddocian christians, and the Assyrian Christians, Greeks were ethnically cleansed or genocided, depending on your point of view [1], by the nascent Turkish state in the 1920's.

I should point out that the event that triggered the ethnic cleansing was a nationalistic, irredentist spasm that sent the Greek army invading Asia Minor to "liberate" it. I'm guessing that the Turkish would have slaughtered the Asia Minor Greeks anyway, like they did everyone else who wasn't a) muslim or b) Turkish speaking, but in the eventuality, it was the Greeks who started it.

As my footnote notes, we call the events of 1922 "The Catastrophe". The Greeks are one of three Mediterranean peoples who have a word that means "disaster", that is used for a specific disaster so that when this word is spoken everyone knows which disaster it means: the Jews have the Shoah, the Palestinians the Nakba. And just like the Jews, the Greeks lost the land our ancestors occupied for thousands of years, we lost our greatest city, Constantinople, and we lost our greatest temple, the Aghia Sophia, which was turned to a mosque.

I cannot in any good faith be a pacifist without acknowledging this bloody history that has threatened to wipe out my people, and expelled them from their land; and not just my own people. Nations are nasty things and they are not, I fear, just jurisdictions. Nations are people. People kill other people because they don't belong to the same nations; not abstract, faceless nations.

If I were to be a pacifist without recognising the fact that the very existence of my people may one day be at risk, what kind of pacifist would I be? An idiot, or a suicidal pacifist, I reckon.

So I'm a pacifist with limits. Kind of like a bounded pacifism, if you like.

But, if it came to that, I would give my life for peace as much as I would give my life for my people.

__________________

[1] Wikipedia calls it the "Greek genocide" (https://en.wikipedia.org/wiki/Greek_genocide). At school we learned it was ethnic cleansing. We commonly refer to it as Η Καταστροφή. The Catastrophe.

Thanks for sharing your perspective and the events that shaped this view.

> But, if it came to that, I would give my life for peace as much as I would give my life for my people.

Staging a nonviolent protest to make the British leave or to let an authoritarian government you're refusing to go fight their war of choice, or trying to help a woman getting mugged by masked militia and getting shot as a result is "giving your life for peace".

But if you'd had the choice of leaving the place before the invadors massacred your family, or fighting back with "all the weapons at your disposal", and chose the killing, I don't see why you are so attached to this "pacifist" label.

I'd summarize your stance as "if somebody declares war on my nation, I will fight with all my strength". Am I getting it right?

This sounds more like non-aggressive nationalism to me. I'm not criticizing it, it's just the mismatch that I find surprising.

Pacifism is:

> The conviction that it is morally wrong to settle disputes (especially between countries) by war or other violent means

> The ethical avoidance of inflicting harm on others in one's daily life.

That's also, more or less, exactly what I was thinking. For instance I don't eat foie gras because I find it inhumane, but I would never call myself an animal rights activist because of that.

I think in modern times we are, for some reason, attached to labels when in reality people's positions are, if they're thinking for themselves, going to be nuanced enough that there will be no appropriate label. Not wanting to participate in the development of autonomous killing machines, let alone ones that inevitably will be abused, is a perfectly reasonable position, but does not at all make one a pacifist in and of itself.

Totally valid criticism from both. I'm just trying to figure things out and I'm not attached to the pacifist label as an identity or anything like that. I know I think violence is for fools but sometimes it can't be avoided, like some of the examples given above.

Sorry for the lag btw, this page fell off my threads and I didn't realise there were replies.

They're fighting for their own existence. Russia has killed, enslaved, and/or tortured most of the citizens of the regions it's already captured, and replaced them with ethnic Russians.

I think "killed, enslaved, and/or tortured most of the citizens of the regions it's already captured" is an exaggeration. That is not to deny Russian war crimes, which are clearly large-scale and horrendous. But I don't think the majority of people in those regions have been killed or enslaved.

I'm a big supporter of Ukraine and have donated to the war effort and hosted Ukrainian refugees.

What happen to Bucha and Mariupol? Why did they get wiped off the map? Was it a tsunami?

Do you believe that the majority of inhabitants even of Mariupol have been killed, tortured or enslaved? If so, could you point me to a source for that? Wikipedia reports its population has dropped from about 425K to an estimated 120K, but reports an estimate that 200K people fled; they report a high-end estimate of 25K people killed during the 2022 siege itself.

What happened to 105K people even using your numbers?

Why is the satellite imagery just huge piles of rubble?

It sounds like we agree that Russian war crimes were vast, but that even in Mariupol, a majority of inhabitants were not killed or enslaved.

I’m not sure why you are combative about this. Do you think any form of moderation or precision in language is surrender to the enemy?

I don't think you realize the creativity and variety we humans have put to use when oppressing conquered peoples if you think resisting an invasion with every means available is the incorrect choice because it kills people.

Being a pacifist doesn’t imply being a doormat. At any rate, I don’t think Ukraine would have attacked Russia under any credible circumstances.

I bet you think it was wrong to fight against Hitler.

You're losing your bet. Also, you might be losing the argument by taking this conversation past the Godwin point.

But, to answer your specific question, no, I do not think it is "wrong" (which is a moral judgment) to fight against people who want to kill others.

This is a complex argument because:

1. I, due to my ancestry, would have been in the outgroup that pretty much any genocidal maniac would be targeting (including that one)

2. I would have been doing my best, back when political means were still on the table, to fight against the idea that letting the bully have his way was the most expedient manner. The whole decade would have gone quite differently if Germany had not been allowed to freely build up the means to invade neighbors willy-nilly.

3. If I had lived in Germany, eastern France, etc. would have been gone with my family way before the onslaught started. If we're letting this looming thing happen, you can have the land and my shopfront. I'm resourceful enough to set up shop elsewhere.

4. Failing (2) and (3), I'd be fighting. But thinking that fighting is the first resort is what allows you to be manipulated by a handful of rich old men who'll send you to the trenches to die.

You are misinformed. Ukraine is used as cannon fodder by western institutions. You talk about Ukraine taking decisions. I can tell you that the normal Joe in Ukraine is completely sidelined in decisions. The whole country is controlled by foreign powers. A lot of western people call this Russian propoganda. They can't see that their own governments are at the wrong side of history. In the meantime it's hypocritical behavior is visible all over the world.

Fully autonomous Ukrainian drones. We don't know if Russia hadn't used something before them.

The two sides are quite evenly matched

I don't think it is about technology - a camera module with NPU running YOLO can be had for like $30 from AliExpress. And a lot of other technological weapons is possible on a cheap, yet nor Russia, nor Ukraine are doing it.

In case of autonomous drones i don't see them bringing any noticeable benefit over FPV until they are deployed in the numbers an order or two of magnitude larger. Both countries seem yet to reach such number of drones. And the large task here isn't just mere production of the drones, it is the whole system of delivery/deployment/management of those large hives of autonomous drones which also needs to be developed/implemented.

Ukraine does a lot of cheap drones that are highly efficient for their price. Russians do some too but their flagship is based on the Iranian Shaheed which the Ukrainians figured out how to shut them down efficiently. The most devastating and feared russian weapons are the glinding bombs (which are packed with a lot of explosive) but luckily for Ukrainians these gliding bombs lack precision.

You're mixing together different drone types (payload, range, operational role, etc.).

>luckily for Ukrainians these gliding bombs lack precision.

Not really. They don't have 3m CEP, that is true. Yet, a 2000lb bomb doesn't need it. They do hit the targeted buildings, which is enough. The main limitation here is that those bombs require military jet planes to launch. Russia is severely limited here.

The lack of precision does matter when we are talking about trenches/bunkers and bombs often missing by many dozens and even hundreds of meters.

Unfortunately they don't miss by hundreds of meters. And Russia frequently uses 3000lb and 6000lb bombs. So missing a bunker a bit doesn't matter - it will still collapse. Here for example it is clearly visible that the bomb misses the building by about 20m https://t.me/RtrDonetsk/25282

https://t.me/milinfolive/100367 https://t.me/arrowsmap/9958

Plus all those bombs that fell in Russia, dozens of kilometers away from the target.

The precision does get better, but still look at the second pic:

https://t.me/milinfolive/150513?single

Of course, there are a number of cases where those bombs go awry. At least a couple fell even right into the Brjansk city. Those cases though doesn't affect much overall operations. Your first link is more typical - about 15-20m off the target.

This is why Russia uses at least 500kg or larger bombs, even 3000kg ones. With that precision they can't use 100kg and 250kg bombs. Which naturally affects how many bombs say a Su-34 can launch - it would have been 8 x 250 and instead it is 4 x 500 or even 1 x 3000. Compare that to say US using 45 kg warhead in a very precise Hellfire missile - the precision hit with that 45 kg warhead in many cases would achieve the same objective as 500kg at 20m.

It's the future of warfare and it will sink the inhibition threshold for starting wars of aggression further.

Why wouldn’t traditional land mines count?

OpenCV + nvidia jetson. A Killer combo

Can someone who got past the paywall tell me what the definition of “fully autonomous” is here? I’m guessing it means the software selected targets based on something the human operators decided when they launched the drone? Is the criteria geographic (any humans in a certain zone), or known individuals (facial recognition), or based on enemy uniforms/visual descriptions, or a specific behavioural rule (anyone emerging from this building), or what?

It flies to a defined kill zone and targets everything there.

> The test took place two years ago and involved quadcopter drones that were programmed to fly towards the front line, cover between 3 and 5 kilometres over around 10 minutes and then engage “Terminator mode”, in which an AI model searches for and intercepts targets.

I can't imagine the news headlines the first time a stolen such drone is used in a (civialian) terrorist attack. Dark times ahead. Fear is already driving polarization and class society where I live. This will just heighten it. Hopefully this is swift, and we return to a post-WWII "can-do" build-up society.

Skynet is manifest.

How would this work for an identical twin civilian?

I hate to burst the New Scientist's bubble, but this is nothing new. We have had systems for decades that operated under "Fire and Forget". We have missles that either go to a pre-designated point or chase a heat or radar signature once they are fired.

Human soldiers kill civilians and other soldiers on the same side. It is called "friendly fire". It is horrible, and should be avoided, but humans are more likely to make this kind of mistake more than a computer or AI model.

The difference is that in those systems a human chose the target. Here, an AI does.

> but humans are more likely to make this kind of mistake more than a computer or AI model

Based on?

What "choosing the target" means has been fuzzy for a long time too. We've had beyond-visible-range missiles for a long time that are basically "fly to this grid square and find a target".

I don't think people realize how much horsepower are in missiles now.

The JSM has at least one multicore computer + IR camera + RF homing for target identification (plus GPS, terrain matching/following and inertial for navigation). It can automatically identify not only the best target (and recognize and ignore decoys etc), but also the optimal weak spots to impact.

The stats of USA using human-guided drones to kill people. A civilian/military ratio and numbers was worse that 11.9.

Heck, check the American drone war crime video Wikileaks published. The one that made the USA so angry that it decided to attack and destroy the journalists.

The USA tends to kill way more civilians than any other military in the world though, so I’m not sure it’s a good example.

Only the USA has enough war experience and drones for us to have high confidence stats on the performance of human drone operators (military vs. civilian targets) vs. AI.

Ukraine and Russia have infinitely more experience with drone warfare than the US.

Stats from Russia/Ukraine are not good. And the ones that exist, could be dismissed for various reasons ("Russians are savages so it doesn't count", "Ukraine is defending itself in existential war so it doesn't count").

With the USA the stats are available and no valid excuses exist to throw the data away. The US military is not defending itself and is supposed to be the most powerful, advanced (tech and policy) and professional military in the world. They are the best case scenario for the human drone operators' performance one has. And yet:

https://worldmetrics.org/obama-drone-strikes-statistics/

I am amused about how emotional people get about AI killing people. In my mind the idea that someone sitting at a screen chosing to blow up other humans is frankly far more terrifying.

A computer is unlikely to go "colonel Kurtz".

Agree. That's why autopilots in airplanes have a much better track record than flesh pilots. And when the autopilot screws up, there is a clear path to improvement, to make sure that the situation will never repeat itself. With humans, people continue to make the same mistakes, no matter how many times it happened before (even for the same pilots).

i dont like it.

hybrid autonomous makes infinitely more sense than this shit. but tbh if the boundaries work... it's not super different from an artillery barrage.

> involving fully autonomous drones set to destroy anything in a given area, with confirmed casualties

I mean, is that really different than a heat seeking misile at the end of the day? If its set to kill everything in the area, its not really using AI for making targeting decisions in the same sense a human would.

Let's go boys! The AI war is so fucking on!!!

I wonder what that means for war crimes responsibility.

Let's say a swarm of these things kills every civilian patient in a hospital or every child in a school. Who is responsible?

I'm surprised Israel wasn't the first to field such weapons.

Not any difference from sending a cruise missile into a hospital killing every patient or every child in a school. The people giving the order to press the button and the people pressing the button can be liable for war crimes (can be because killing civilians by accident isn’t necessarily a war crime or even having collateral civilian causalities).

Imagine sanctions killing a million civilians due to insufficient medical care. Imagine firebombing Tokyo. Imagine dropping a nuclear bomb on a city full of civilians. Imagine genociding Palestinians. Imagine bombing a girl's school, killing hundreds.

Who's responsible, AI or a human? That misses the point that noone seems to be responsible at all, even in democracies.

We all know who is responsible, but you are right.

It doesn't mean anything new. The country or entity that deployed them is responsible for their behavior.

Whether any particular country or entity can be held responsible is another question.

Seems to me like every single person who enabled the process should be held partially responsible, with whoever gave the final approval holding the largest portion of that responsibility.

Reply on news.ycombinator.com