On a separate note, I'm curious as to whether AI is making an inroads in that space. I would imagine very minimal, if at all, but very curious.
On a separate note, I'm curious as to whether AI is making an inroads in that space. I would imagine very minimal, if at all, but very curious.
The drone industry was allowed to basically "do whatever as long as it works", consequences be damned. So they use civilian motors, batteries and SoCs, sketchy firmware with zero code inspection, and more. Does it work perfectly? No. It works well enough.
I wonder if anyone is going to learn a lesson about overregulation.
I'm not sure if "AI for red tape mitigation" is a thing, but "AI for killer drones" sure is. I suspect that "killer drones are insufficiently smart" is easier to fix with AI than "too much red tape". Because the amount of red tape, if unopposed, will expand to consume any capacity of dealing with it, AI or not.
Seems unlikely. Regulation and Health & Safety are both societal luxuries, which only happen once societies are stable and prosperous enough to start valuing human life beyond its ability to perform labour.
The moment the bombs start dropping, the time for luxuries also stops, and the value of human life drops to value a person can produce defending their society. There isn’t the money or resources for anything more than that.
The US (most developed democracies) places an extremely high value on the lives of soldiers, because dead soldiers in foreign wars does terrible things to politicians in power. Paying 1000X more for the same tech as Ukraine to minimise the number of service members killed using it, is a pretty small price to pay.
Rules and regulations on safety and health will maintain combat effectiveness and manpower where the loss -even temporary due to injuries or sickness- of well trained specialists (and don't forget that even a "simple" infantryman is a highly specialized expert in his field!) is not acceptable. Those rules were written in blood and modern western militaries can not sustain the rate of loss that Russia seems to be ok with. Western leader will be well advised to try to minimize losses to real combat casualties.
But I sure think that they will start to cut corners, at least where it comes down to documentation and purely cya.
> the value of human life drops to value a person can produce defending their society.
OP was talking about how US munitions software needs to go through a 6 week long integration test before it can be deployed. I seriously doubt that kind of testing would last very long if the US was engaged in peer level war, and their enemy had found a flew in their munitions guidance systems that made the munitions useless.
At the end of the day, when at war time isn’t just money, it’s also lives. When you have people dying on the frontlines, the risk of equipment failures from lack of testing will be substantially smaller that loss of lives from ineffective equipment, that can only be improved every other month.
Preventing that is much more important than the exact dollar efficiency of said equipment during peacetime.
Regulation - or more generally - formalization comes with scaling up. A skunkworks project can innovate really fast, and has no integration and scale needs. When you want to scale up any project (hardware or software), integrating and scaling become a real bitch, and you need to ensure that everyone is on the same page or face costly "silly" mistakes that history is replit with.
You can't magick away coordination challenges by labeling the process "red tape." This happens every single time any small nimble organization grows beyond certain thresholds. On a personal level, organizing a trip for 3 friend is process-free, but for 10+ people requires checklists and heavier processes, for 30 people it becomes a nightmare requiring professional assistance. Low probability events become regular occurrences when you scale, and you have to plan and/or mitigate them adding "red tape".
It matters if you care about 1, 2, or 10 out of the 30 people on the trip missing a flight, getting lost, or going hungry.
Of course there's a bare minimum for a product that works at all. Beyond that there are increasing levels of rigor that focus on reliability, and these can be non-linear.
As an aside, the word Guerrilla (little war) was coined during Napoleon's occupation of Spain to describe the resistance effort by locals and peasants against the French army.
Every Goliath may, in the long run, meet a David that beats it, but this premise ignores all the thousands of Davids that don't win.
If you glass the villages and salt the fields, you even win against the taliban and vietkong.
You may win tactically, but you lose strategically - firstly by demonstrating that surrender is pointless, and secondly by creating a martyr movement across the world.
When you sow fields with salt, the only harvest you should reasonably expect is more blood.
Yes because Ukraine fights an existential war and at this point on both sides people just shrug when a few civilians get blown up.
The US isn't under existential threat and when they go to war their highest priority is to never risk the lives of operators and if possible, if only for PR reasons (and even then it doesn't always work) not generate news about rogue missiles or rogue killer drones. The attack on a school in Iran that killed 150 children apparently was already the result of a rushed mission that ignored procedures because this kind of thinking is starting to take hold in US defense circles.
That's not just an ethical disaster but also a political and strategic one because these events can rally enemies around a regime and the political arena is where for the US wars are won and lost, both at home and abroad.
Caution needn’t spiral cost. The reason US weapons cost so Much is because it’s profitable.
Building things that work 80% of the time makes sense in wartime. It doesn’t as a rule. Hence wartime production will always be cheaper.
Americas problem is that the military industrial complex is built to maximize cost and profit for private corporations, despite them being entirely dependent on government.
Until they are nationalized, and the profit margins are eliminated, you will always pay 20-50% more than you should and gains from efficient won’t be realized.
Look at the auto industry in the US. It’s protected by tariffs and still incapable of matching the Chinese and others on cost. It mainly survives because of incentives which subsidize vehicle types other countries don’t want (pickups) and Americans only buy because of incentives.
Iran is building drones for £3k. The US clones cost 30x that for “additional features” the spec didn’t ask for.
People say “it’s a one line change” (once they argued it was a 1 bit change!). But lacking a fully controlled and hermetic build system with its own exhaustive test suite you can’t be sure about the relationship between the source and the binary. And that continues to every step to get the binary into production (updating existing devices, etc).
Sure, your ultra paranoid checking of everything might catch an extremely rare bug caused by something like interactions between a benign code change and a build system. But is it worth slowing down the development process by that much?
Is it worth missing out on an entire generation of technology, like what happened with US and the shift from 00s drone warfare and 20s drone warfare?
Usually not.
For the consensus algorithm in your distributed database? slow down there buddy...
You have to ask: how bad could this get? How hard will it be to fix? Could we loose or corrupt user data?
> I wonder if anyone is going to learn a lesson about overregulation.
This also misses the point imo. A simpler answer is "necessity is the mother of invention". There is value in a regime for peacetime. One is also a fool if they do not recognize needs change drastically in wartime. Two things can be true. The United States, like nearly all sensible nations, has almost always understood this and acted accordingly. On the other hand, nations that govern themselves as if they were on a perpetual war path are usually far less desirable societies. The idea that we need to speed rush "AI for killer drones" because otherwise we will find ourselves on the wrong end of an existential invasion are nonsensical. Americans would be far better off if our leaders and our people stopped acting like every potential conflict was existential.
There is no Russia on our borders. The only thing American adventures overseas have accomplished in the last two decades is making our country weaker.
In Ukraine the military will take any drone they can get their hands on, so all you have to do is build a drone, give a bunch of them to the army to try out on the Russians, and within a week they will tell you if it works or not. So your design iteration loop is probably weeks. If you are successful, the time between hearing the general say "give me 1 million" and when the bulldozers start clearing the factory site is probably measured in days.
By comparison, if the US products fail, there's no real negative effect on the mainland United States.
It's even worse than that. Schedules slipping and cost overruns are good things for the manufacturer, because they can charge more on top of their initial contract. Cost-plus ftw.
But you still run into similar issues regardless of the contract structure. Try and build a rail network without anyone in government wanting something changed from the initial design for 20 years.
Most are paid to prevent projects with a given defect type from proceeding. They aren't rewarded for the number of projects that succeed without defects. Preventing CYA from running wild is a legitimately hard problem to solve.
Well yes, that and the fact that cheap drone guerilla tactics have fairly recently become a technological possibility. Remember that Ukraine is actually a bit late to the party here, with Hezbollah and ISIS having used cheap drones with cameras and/or explosives tied to them years before Ukraine or Russia did. The asymmetry in cost between those cheap drones and the existing "more hightech = more better" militaries were (and are!) used to was already established. That a party such as Ukraine faced with a more advanced and much larger opponent would lean towards such an approach makes a lot of sense. Ukraine did not (and does not really) have significant amounts of the traditional stuff.
Now given that they chose that path, they have been very effective recently, but note that the tethered fiber-optic drones were a Russian invention. So even that deeply corrupt, large dinosaur of an institution innovated significantly. It is also important to note that a significant part of the recent successes of Ukraine are due to them having Starlink access and Russia no longer having it.
I'm not saying the sheer will to survive or the inventive organisation of the Ukranians did nothing (far from it), but I do think it is a mistake to think that their success should only be viewed through that lens.
Ukraine fights back or they lose their sovereignty. Most of the conflicts the US gets into, it's entirely a choice to put soldiers at risk.
So yeah, the evaluation of war effort will be different, because the situations are completely different.
Startups = have few resources, product has to work or company dies
Big tech = minimal cost of failure, instead minimizing risk
And yet this mechanic is also why startups are able to innovate and bring new products to market so much faster.
Or you're batching your releases into larger builds because you know it'll take 6 weeks to test regardless. This increases the duration of each development iteration because you have 100 things you want to do and you could do that in, say, 4x13 week efforts, but with the added 6 weeks between iterations (and possibly more after it leaves your shop) that takes a one year effort and turns it into about 1.5. So the program office decides you should do one big release each year, which also ups the risk because a lot of testing that would catch bugs isn't done until the end in that big 6-week test effort. Oops, now your 1 year + 6 week effort just got turned into 1 year + 6 week + (unknown rework time) + 6 weeks. Probably 2 years.
It's also a reason to be skeptical of a military spending a bunch of money developing technology during peacetime. In reality the expensive stuff they went into the war with is always going to be less effective than the cheap stuff they came out with.
I assume that smaller/cheaper drones avoid a lot of this because the stakes aren't near as high and quite a bit of the development occurs in private industry first.
See also SpaceX vs. NASA. No way would NASA have been allowed to blow up as many rockets as SpaceX did to finally get to their working solution.
The same people when SpaceX blows up a bunch of rockets: "wow, look at the innovation, they move so fast! Cut NASA funding and give public funds to the guy who purchases elections!"
The last time NASA caught any serious flak was what, the Starliner shitshow? And that was just splash damage from Boeing getting dunked on by everyone at once.
I'm not sure what timeline you're thinking about, but JWST was launched pretty recently and it's pretty ambitious. But more to the point of my earlier post, NASA's "lack of ambition" is probably directly attributable to the "small government" people who penalize ambition in the public sector and praise it in the private, government contractor sector. The incentives to be ambitious in government are perverse when every "failure" is scrutinized and condemned by people who want government to fail so that they can justify taking public money and dumping it into private bank accounts.
For every Curiosity and JWST, there's ARM and Artemis. It seems like it's getting better now, but very slowly.
1. Something blows up.
2. It gets pasted all over the news.
3. People wonder why we give NASA money to blow stuff up
4. Congress people with room temperature IQs grill NASA admin for months.
5. NASA becomes risk adverse.
6. Today.
There's some sort of happy middle ground between flying a ship that has a very significant chance of a catastrophic failure killing all crew and can't even fly unmanned, and almost not letting Ingenuity fly because the chance of failure was deemed too great. NASA didn't find it.
Milspec is expensive and process heavy, see what a B52 replacement trash can costs, for just one example.
There is a process for getting a change into version control. Each change needs to have a (virtual) paper trail: motivation, risk analysis, sign-offs &c.
If you can't get something into VC quickly, you can't really do CI.
The obvious solution would be to have an integration branch that doesn't need the process to get in, do CI testing on that branch and then make the process for merging to the real branch.
I've never seen this done personally, but I have been told some places do it, and then you end up with "Change X, which got approved had a dependency on Change Y that didn't get approved and we didn't realize it until now because Change Y was put in the integration branch before Change X"
The dependency problem doesn't exist, because all the features were already approved to be in the release. The only way there would be a problem is if someone decided late in the game to pull a feature and that feature was a dependency to something else.
I also maintain that it is impossible to know which changes depend on other changes. In one case, applying a bugfix that changed the order of allocations at startup caused vtable corruption somewhere else because it changed how much padding a particular malloc() call was returning, and someone was writing past the end of their allocation.
[edit]
Also note that what you described is not CI; things are developed on their own branches and not integrated immediately.
I do think there is something to be said for both perspectives, especially for code that is extremely critical. With sufficient testing and determinism maybe you can actually make sure that dormant issues stay dormant meaning there is real value in being change-averse. Still it's a very precarious situation having a known memory corruption hoping it's the testing has made sure its benign in practice.
There was no memory corruption previously due to partially to luck, and partially to heavy testing (which would have exposed most forms of memory corruption).
I think it is fare to say that the change was a cause of the vtable corruption occurring, since without the change it didn't happen.
Once this is discovered, you need to rethink your change plan for the next release; if you back out this one change, your software will return to a working state. Whether doing that, or fixing your buffer overflow is the correct thing to do depends on a lot of specific factors.
Roll back the change? Also, fix the approval process - no way that should have been approved.
Generally speaking that is risk management, an unavoidable engineering tradeoff. In lower stakes situations, for example a critical application or server for a small office, we let low-impact bugs accumulate: Imposing risks, and therefore eventual costs, to avoid minor workarounds and low-impact bugs is poor engineering and risk management.
Engineering and all risk management includes tradeoffs. It's easy to criticize the downside of the tradeoff - the same people criticize the reverse decision when the server (or drone) crashes - when someone is not responsible for both sides of it, when they are not accountable for their words when the outcome occurs.
That's speaking generally. It's also poor risk management to be overly safe. I don't know about the parents' situation. But drone crashes (risking humans), mission failure, $50 million losses, and associated downtime (including delays) and labor costs, seem like high costs that are worth some pain to avoid.
You used to be able to take a hit and survive a war. Those days are gone. Now you die because 1kg of C4 blew up your entire ass, or you take a less dramatic hit but you will never be dragged back to a field hospital.
Eventually the US or similar will have to get into this kind of war, and there will be a come to jesus moment for all the hoo rah americans who think your chances of surviving a war are based on anything other than sheer luck.
This is Bad, man.
Nukes already showed you can't make a weapon so crazily deadly and destructive that man would end war, so things will be bleak for the rest of humanity's reign.
artillery, missiles, and long range drones are in the mix too. AI enabled spotting makes ISR detection rapid and effective.
some kubernetes container spots a random pixel that means hidden vehicles and a HIMARS strike is dispatched ASAP
For example, do you agree that Britain's and France's appeasement of Germany before WWII was the right thing because an attack wouldn't have been self-defense? Or, what about attacking another country to help defend an ally who's being attacked by them? That's not defensive, so I guess it's wrong by your standard for any other country to defend Ukraine. What about defending them by supplying arms and soldiers? The line gets blurry fast.
How about re-taking some recently lost territory? Is that wrong? For example would it be wrong for Ukraine to attack Russia to regain its eastern areas that Russia took at the beginning of the war? Or for Russia to retake any other parts of the soviet union? How about either North or South Korea attacking the other? If everybody opposed such non-defensive wars, they would be severely disadvantaged to a country that incrementally takes pieces of their territory in a ratchet effect.
What about "liberating" the people of another country from a brutal dictator? I'm sure you'll oppose this because it's like Iraq or Syria, but is there really no case where it's justified? Not even Pol Pot's Cambodia where it might have saved a quarter of the population from death it somebody had intervened?
Also recent advances in battery tech brought increased energy density: the same drones which had range 20km now have 40km.
(The killcam is a WW2 invention, starting with linking cine cameras to the machine guns of fighter aircraft)
We want to perform our work skillfully, effectively, and professionally. But we never want our tools to actually be needed.
(Another is that we can't effectively create a shield without the risk of it being used as a sword.)
If you make a hammer, it can always be used to murder someone, but if you make an AK-47, there's only one way it can be used. So if you don't want what you make to be used for killing, don't make an AK-47. If you 're good at toolmaking, choose to make tools that are not weapons.
Even when it comes to more expensive things like cruise missiles it seems the planning has to be that some high percentage of them may be shot down (and much higher for slower moving drones), so you really want them cheap and in high volume, with reliability somewhat of a secondary concern.
Not to bring Tesla into this, but the contrast here is stunning. From a component manufacturer about the mindset of Tesla:
"Hey, we sent you over the new firmware for the component, check it out." (The test suite for this component takes approximately 36 hours to execute.)
Three hours later:
"This is working so much better, thanks a lot!"
"???"
"Oh, we just flashed a car we have here and took it out for a drive."
"?!?"
Oof.
I'm surprised that someone who uses such a phrase was working on classified hardware in the "mid and late 00s".
tl;dr, not in practice. Far as I can tell this is still the SOTA in FPOV drone autonomy:
https://spectrum.ieee.org/ai-drone-racing
Basically, those guys trained a drone to beat human FPOV racers but they had access to the race course layout before the race and trained extensively on it. Can't do that on a battlefield.
Also: no shooting at enemy drones during FPOV races. Makes surviving to the end of the race simpler.
[1]: https://www.documentcloud.org/documents/21211671-1997-revisi...
Are Spanish people white or Hispanic according to those definitions?
'Original peoples' is an interesting phrase. Neanderthals? Beaker people?
A single category for everyone from Pakistanis to Japanese is weird.
Sounds totally legit.