USAF’s Missing Unmanned Combat Air Vehicles (2016)
thedrive.com
thedrive.com
1. "Such a system could find, fix and finish a target without external direction by a human controller."
The fact that human-out-of-the-loop kill decisions is a bad idea should not require further elaboration.
2. "Suddenly, a simulated threat radar activated. The pair of networked UCAVs immediately classified the threat and executed a plan to destroy it based on the position of each X-45 in relation to the target, what weapons were available, what each drone’s fuel load was and the nature of the target itself. The calculations happened in a blink of an eye."
Congratulations, now all of the adversarial techniques that make state-of-the-art neural networks fall over will apply to fighter jets as well. Does the system deterministically plan to attack everything it sees that looks like a threat? What about easy threats that show up first, followed by progressively more challenging / fuel-draining threats? Now instead of radar jammers, the signals guys will go back to building elaborate decoy generators.
Without a human in the loop, our current autonomous technologies are woefully inadequate for determining whether or not something smells like a trap. Our enemies are going to learn how to knock these things out of the sky with a $200 SDR and a power amp.
A missile with an advanced AI gets transported to the Delta quadrant in the same way as Voyager was. It was already en-route to a target planet. Obviously it lost lock. It then used what information it had about the planet to find it again. It found it – except it wasn't the same planet, it was a completely innocent one. And set a course. It correctly calculated that the probability of two planets having the exact same parameters was infinitesimally small, so it must be the correct target. It was further unconvinced that it was, in fact, in the Delta quadrant.
It also disregarded the orders to shut down, which came from the same engineer who reprogrammed it, believing that she was a rogue agent.
Makes you wonder what will play out in real life as we go into the AI age.
Really the worry here is that AIs will be just as bad at decision making as humans.
A semi-recent example is the shooting down of MH17, which was shot down by Russians or their allies because they mistook an airliner for a military aircraft, even when their flight profiles were totally different. The controllers were expecting a military aircraft to arrive around that time and didn't stop to consider the alternatives, even when the target didn't behave properly.
There thing that is automated is the first phase threat identification and the generation and execution of the attack plan, not the threat verification or decision to execute. Which is fine IMO.
With a plane-sized stealth drone, you can use inertia/gyro guidance to eliminate the GPS risk. Seems silly to build a stealth aircraft that has to transmit and receive instructions. Where do vehicles like this fit? You have long-range cruise missiles, cheap, long loitering drones with hellfire missiles, manned aircraft, and these unmanned fighter-jet class devices already.
A weapon like this wouldn't have super-long loitering time, but would be potentially more stealthy and more disposable than a manned aircraft. It's pretty obvious why it's secret... it's an air-defense buster, strike platform against a nation-state (vs. rabble), delivery truck for special bombs, etc or a nuclear weapon delivery truck.
This
If AI can beat humans at strategy & bluffing games like Starcraft & poker, why couldn't they defeat humans at detecting & defeating anti air traps ?
Also the goal isn't necessarily to beat the other player -- making their planning system crash or lose confidence in itself can be more than adequate.
I don't think these problems are comparable.
Maybe so, but this is an inevitable arms race. What happens when the other party has drones and we ned to respond faster than the human can make the decision?
> now all of the adversarial techniques that make state-of-the-art neural networks fall over will apply to fighter jets as well. ... Without a human in the loop , our current autonomous technologies are woefully inadequate for determining whether or not something smells like a trap.
I'm not sure humans help here. The interesting adversarial examples today are complex images that humans are uniquely good at parsing. But these things are doing to be consuming radar, signals, etc that humans don't really have an advantage with. Not saying decoys etc won't happen, but I don't think humans help here.
However it feels like he is falling into the same trap that most of the media falls into constantly, thinking that AI & Software are easy.
If he thinks the F-35 was hard to launch with all it's software that's nothing compared to an autonomous combat swarm with all the features he's talking about. You can't rush out stuff that controls machines killing stuff.
My guess is he's more of an aviation guy than a software guy so this stuff somehow doesn't seem as hard as it is.
He also mentions the USAF has had a lot of black programs but then continues on with the thesis that they're ignoring this as opposed to continuing to develop in the black.
Also these swarms will be least effective in the kinds of operations we've been mired in. It's a lot easier to set a swarm in motion with orders to clear the sky in a WW3 scenario than it is to have them try and shoot a particular pickup truck filled with civilian-clothed possible enemy combatants in an urban area in Afghanistan.
Having the good judgement to not obliterate the truck while it's yielding for a funeral procession is the hard part to do in software.
I agree he's underestimating the software complexity. Anyone can built that crap. It takes tons of R&D man hours to refine it into something that actually works and works consistently in the real world.
They can build it for simple tasks. Find the best route to go there, bomb that specific target, come back and during your mission deal with a limited set of defense scenarios.
I'm really interested in what the "next phase" of aviation combat will be, or if there even will be a next phase. It's possible some organization would create a weapon that would physically disrupt any vehicle or object flying through a certain patch of sky - that may push us into a air-to-groud laser or smart-guided weapon age to counter those kinds of measures, and also means air vehicles will need serious intel platforms to get around them. We also may see vehicles that can transition from air to sea and retain full combative power, anything in the skies that can't float at that point goes the way of the do-do, no matter how intelligent it's systems are, so maybe the USAF is waiting until it's clear what will work for the next 50 years, while other branches invest UCAV technology.
*air-to-ground, not ground-to-air
"Boeing’s control software ... was called DICE, or Decision Mission-Control Software."
Okay, well, I see where the D and the C in the acronym comes from, but...
https://en.wikipedia.org/wiki/Lockheed_Martin_RQ-170_Sentine...
All that makes me think that things actually have not changed, but you don't want to admit it, and so you are claiming they have changed. But perhaps I am mistaken about that.
For the cost of about one of those cruise missiles ($25k/JDAM versus $1.4m Tomahawks), and a lot less likely to be intercepted by air defenses.
https://combataircraft.keypublishing.com/2019/02/27/f-117-ni...