The US Air Force successfully tested AI-controlled jet fighter
arstechnica.com
arstechnica.com
Thus down the slippery slope we go. In 20 years time we'll probably have aircraft that do figure eights over enemy territory for hours before automatically engaging 'military aged males'.
Slaughter bots is the ultimate conclusion to this: https://www.youtube.com/watch?v=O-2tpwW0kmU
Ethics don't go out the window because of autonomy. It's dark, but it's not somehow easy to shrug off as "ok no human then no ethics". We already have semi-autonomous weapons such as CIWS (Goalkeeper/Phalanx) which are autonomous because it's very tedious for a human to sit idle and wait for threats and then it's really hard to hit them. Perfect job for a robot. But the ethical job of the human in that case is ensuring that the weapon isn't armed if there is too high risk of collateral damage (These sit on ships, typically, so a human decides whether it's safe to arm the weapon given the situation around the vessel).
The dumbest autonomous weapons are mines, they are hundreds of years old. The ethical decision is made when laying down the mine, not when the explosion is triggered. So yes it's a slippery slope, but the "human in the loop" isn't only ethical when it's the kill decision. There is a "human in the loop" when laying a mine too. The ethics involved consists of weighing the risk of killing the wrong target, properly documenting where they are planted and so on. There is no human "in the loop" at the time the mine kills someone. But that doesn't somehow throw ethics out the window. The person deploying the mine - or the slaughterbot - is the person in the loop.
> In 20 years time we'll probably have aircraft that do figure eights over enemy territory for hours before automatically engaging 'military aged males'.
I think that is unlikely, but possibly "armed" personnel. We already have craft that do figure eights for hours before automatically engaging specific signatures of vehicles (if we'd want to). And as I said, even artillery shells do this. But yes, finding a concentration of troops and deciding whether they are soldiers/civilian isn't even 20 years away.
I'm not saying we should bring landmines back, but "human in the loop" AI warfare will only work so long as our AI maintains the same relative military dominance we've enjoyed for the last few decades. The moment an AI squadron gets wiped out because the human approval couldn't come fast enough, it'll go right out the window.
If the US doesn't need landmines, why won't the US ban them? The United States is one of the nations that hasn't signed the Ottawa Treaty?
It's all a power play at the end of the day, the ethical argument is window dressing. Some people take window dressing very seriously, but don't mistake that for being the decisive factor in policy.
Q: What’s the difference between a wedding and a group of insurgents?
A: I dunno man, I just fly the drone.
The latter may also be true, but that wasn't what they were claiming.
Of course there is. "AI" controlled hardware doesn't care about getting out alive. A human is more likely to have an itchy trigger finger because a mistake means death.
How would a stressed human in mortal danger be preferable here?
https://theintercept.com/2015/11/19/former-drone-operators-s...
"U.S. drone operators are inflicting heavy civilian casualties and have developed an institutional culture callous to the death of children and other innocents, four former operators said at a press briefing today in New York."
It's a lot easier to be callous towards pixels on a screen, IMO, let alone an AI model trained on past data that makes the shoot/don't shoot call. I recognize that combat stress can cause bad decisions to be made, but I don't think the cost/benefit calculus is as clear-cut as you're making it out to be.
What altitude do you think these payloads are dropped from? The targets are pixels on a screen regardless. I think the issue you raised is worth talking about but I think it's orthogonal to the AI issue. The AI kill/no-kill issue can be mitigated via process. Reviews, shorter "deployment", rotations, etc. We aren't creating AI systems to fight Taliban, it's for a future war where real tangible peer threats can touch you. How would you process away or mitigate the scared young grunt or pilot who are facing death?
I'm advocating for humans remaining in the loop btw.
The promise is already a farce because autonomous weapons that sense the environment and make unilateral decisions to kill have already been in use for decades now. From low-tech landmines to high-tech ship-classifying CAPTOR torpedoes which fire themselves, a weapon sensing its surroundings and deciding to kill is nothing new.
And with landmines - they're hideous and we shouldn't want more things like them anyway.
Yeah, the humans program the torpoedo to discriminate enemy ships from others, and then entrust that classifier to make autonomous kill decisions. How will autonomous drones and missiles work any differently? They're going to be precisely the same; classifiers engineered/trained by humans entrusted to make decisions to kill. They might shoot a city full of civilians, and a CAPTOR torpedo might shoot a ship full of civilians too. It's nothing new, it's more of the same brought to a wider scope than before.
But more generally, I see what you're saying: it's the same problem, but at a different scale - in this case, the scale of "distance from the weapon". Minefields are very localised; underwater anti-submarine mines require a submarine; autonomous aircraft are just the same, but with a much bigger range.
However, I think the range matters. Civilians avoiding a war zone in a ship or a minefield, while bad, is not the same thing as autonomous aeroplanes able to go to a static civilian population and fire at it.
There are many factors on and off the battlefield, such as the domestic and geopolitical spheres, that go in to targeting. Only at the minimum level of an AGI that’s capable of understanding human intentions and situational nuances can potentially remove a human from the loop.
That does depend a lot on the detection vs kill range vs time to kill. In a close air dog fight sure but most modern fighter doctrine is focused around long range kills and stealth already. Cannons are nearly vestigial on the F35, it only has ~4-5 seconds of ammo worth to fire.
> The last war broke out. All the people are dead, but the machines continue dutifully to follow orders.
With wmds, there are humans who make the choice at the end of the day. The loss of life scale is not relevant as much since we could make ai powered wmds as well, the fundamental question is "can a computer kill?" And maybe more importantly "who is responsible for it making mistakes? L"
E.g. Similar to the move from pets to cattle in computing. A jet fighter can very much be considered disposable and swap safety features for additional payloads. The squadron could first coordinate in a pattern far more sophisticated than what humans could achieve, then when the payloads are all deployed fighters revert to a kamikaze mission and crash into nearby infrastructure.
The next war is going to be out of a sci-fi book.
Other problem is that they won’t be cheap. High performance military aircraft are expensive. My guess is only get factor of two in cost. Also, there is size tradeoff with payload. Drone that can’t carry AMRAAM is useless.
The purpose of fighters have changed. Missiles have taken over many of the roles. The roles that remain require intelligence. Both Ukraine and Russian fighters are not being used much because SAMs make things too dangerous. When they do, it is low level attacks that would be hard for drones.
I think developing drone fighter AI would be hard. Recent AI advances have been more about generation than planning. We could do it but would be expensive; look at how much has been spent on self-driving. The basic things are simple but the important things are complicated. For example, drone could have intercepted and shot down balloon but couldn’t have inspected balloon or involved in planning.
Finally, the US has pivoted from developing drone fighters to bomb truck. The idea would that accompany fighters and carry more ammo. It would be less maneuverable and simpler and use extra space for fuel and bombs. I think it is telling that multiple countries have tried drone fighters and none have gone for them.
One of the reasons for it being pilotless is it can fly moves/turns that create G forces no human pilots could stand with their jump suit.
But you know, Taranis has all gone very quiet, slipping out of the public's memory.
This theory is in the latter part of Tyler Rogoway’s “The Alarming Case of the USAF’s Mysteriously Missing Unmanned Combat Air Vehicles”
https://www.thedrive.com/the-war-zone/3889/the-alarming-case...
Carrying enough fuel to go some far distances and back takes up space. Missiles and bombs aren't always small. If you're carrying a lot of payload/fuel weight, you're going to need to have enough surface to generate enough lift, etc. If we're planning on these birds to run similar-ish kinds of activities, I don't know they'll be that radically different. But maybe the missions will be radically different.
> A jet fighter can very much be considered disposable
A jet fighter still usually costs a few million to acquire, before the cost of the pilot even come into the picture. Once again, if they're gonna be built to handle the same mission profiles, I don't know the acquisition cost is going to be radically different. Probably a bit cheaper, but what costs more the seat or the engine? The stick or the hydraulics that actually actuate the wings? I wonder what the real savings are to take the seat and life support out of the plane. Like if you made something like the F-35, but no seat and no life support and no fancy targeting helmet, what's the per-unit cost? Something tells me still probably a few million. It'll be a lot cheaper to lose one in the end not having a human in the seat, don't get me wrong, and I imagine there would be less hesitation to deploy them in riskier deployments since there's no human in the seat, but I don't know I'd use the term disposable to talk about a few million dollar piece of hardware.
But I doubt pilots will be dog-fighting or doing their own bombing runs in the near future.
The "Loyal Wingman" project is already underway to build that, though not as a swarm.
https://en.wikipedia.org/wiki/Boeing_MQ-28_Ghost_Bat
India is doing the same thing with their CATS
I doubt pilots will be dogfighting or doing bombing runs because those aren’t done any more.
https://vimeo.com/67768281 https://www.youtube.com/watch?v=LiuVInSnTZs
2) Trillions haven't been spent on the F-35 as others have mentioned. Those numbers are outlays for the total of all R&D + procurement + maintenance for several decades + any specialized equipment needed for maintainence + some other things I can't remember off the top of my head
3) You're years behind the military on this. One of the ideas behind the F-35 is to be able to start integrating unmanned vehicles commanded by the F-35, and be a stepping stone for developing full manned-unmanned teaming for generation 6 fighters.
F-35 is probably why don’t do drones for a while since will have bought a ton of great fighters that will be good for decades.
If we diminish the need for humans in service, we dilute the viability of the pro-military contingent to continue to manipulate our democracy.
If removing humans from kill decisions reduces the size of our forces, it might be the feedback loop we need to finally kill the US military Leviathan.
Is how we get SkyNet.
Leaving humans in kill decisions is how we got every war until now, probably a kill count in the hundreds of millions. I'm ok trying something else.
Hard pass.
On second thought, maybe not the best idea for armed drones...
I think that trope came up in the time (of Sci-Fi) when it was thought that an AI would be a logic-based supercomputer of some sort.
Neural network based AI presumably won't suffer from this issue because neural networks do not depend on logic at all for their functionality...!
There's a cool video of that jet following the lead jet using neural nets, but I can't seem to find that online.
With AI/NeuralNets having made significant advances since those days (2003?), presumably this test craft is a lot more capable.
[1] https://www.nasa.gov/centers/armstrong/news/FactSheets/FS-07... [2] https://arc.aiaa.org/doi/10.2514/6.2008-6985 [3] https://images.nasa.gov/details-EC03-0231-4 [4] https://www.amazon.com/Results-Intelligent-Adaptation-Simula...
It's the 24/7 always in the air drone bombers with AI that have zero hesitation to murder civilian targets on demand or by "accident".
And if I were to write this 20 years you might have still dismissed me as a kook or doomsday prophet, but now one could argue that's already half-implemented anyway rather than a description of a future dystopia.
These have been in use for a few years now. You can tell when they're used from pictures of the car wrecks they leave behind. A very distinct 6 pointed star shape cut through the car roof: https://www.bbc.com/news/world-middle-east-39109438
Even if you need a human crew to handle the stuff around the coasts it seems like a good place to start with automation.
Maybe something like a Jetson for the ANN processor? [2] I'm sure NVidia could provide a milspec part for their use.
[1] https://www.nasa.gov/centers/dryden/research/IFCS/index.html [2] https://developer.nvidia.com/blog/jetson-nano-ai-computing/
this movie writes itself!
https://www.vox.com/culture/2023/1/11/23548955/m3gan-horror-...