When one of those black boxes malfunctions it gets taken off the road. When the AI malfunctions, are we going to shut down entire classes of vehicles until the problem is confirmed fixed?
Not to mention that most software fixes cause other bugs...
Not to mention that most software fixes cause other bugs...
We have precedent for how we qualify and evaluate things for safety: test them across a variety of conditions, accumulate driver-miles or operator-hours and incident frequencies. Then, using that data establish a bar for what constitutes an acceptable level of risk given the utility something provides. If we wanted to ensure nobody ever died in a car accident, we would ensure there were no cars, but collectively we've made a different choice.
Shutting down a plane is completely different from taking an entire class of publicly owned vehicles off the road. People will be furious.
Yes, they will be furious about the deaths and the shutdown, both. Don't forget that people are made up of individuals.
> entire classes of vehicles until the problem is confirmed fixed?
Yes, a malfunction AI would have to be grounded, just like for example the Boeing 737 MAX is now.
Yes of course we will. What is the problem with that approach? That is the exactly logical thing to do and will be done.
That's an extreme example, but automotive suicides that kill other passengers, drivers, or pedestrians fall into the same category. Consider also deaths from accidents involving drunk driving or fatigue -- thousands of motorists take to the roads every day modified in one manner or another that reduces their driving aptitude.
Also, while it may be correct to say that computers don't "fear death", there's no reason that "risk to self" can't be part of the criteria for decision making by an autonomous system.