Trolley problem
en.wikipedia.org
en.wikipedia.org
I'm of the opinion that touching the lever would make you liable for the death/harm of the single individual. Sure, you "saved" 5 people and prevented them from coming to harm. But you knowingly decided to harm someone completely innocent in all of this. In my book, that's as good as letting go of the trolley in the first place. i.e. It's no longer an accident, but rather a deliberate (and arguably malicious) act.
But people are more in agreement with you than it seems, because changing the formulation to the (ridiculously impossible) "fat man" version of the thought experiment causes most people to change their mind, even though the morally salient features of the experiment (choosing to kill one innocent person in order to save five innocent people) have not changed.
This explains the apparent conundrum of divergence in the Fat Man version. If we push him off the bridge, there is no time for good fortune to save him, but there is time for the group to escape, self preserve or get lucky.
Also who will get sued when it actually happens.
This shifts the ethical and moral burden to the human driver as it should be.
Though Armstrong in "Smarter Than Us: The Rise of Machine Intelligence" makes an interesting point:
"these programs [autopilots and stock trading programs] occasionally encounter unexpected situations where humans must override, correct or rewrite them. But these overseers, who haven't been following the intricacies of the algorithm's decision process and who don't have the hands-on experience of the situation, are often at a complete loss as to what to do - and the plane or the stock market crashes."
This is pretty much what happened in AF447 (http://en.wikipedia.org/wiki/Air_France_Flight_447). In a self-driving car case, I hope the human will be able to exercise at least a defensible judgement.
I find the future of ethics of intelligent machines fascinating. I plan to put a lot more energy into this area.
We do seem to be rapidly heading toward an "interesting" place where assistive driving technologies are good enough that a lot of people realistically won't pay attention while driving (given that plenty of people text and use their phones even without such technologies).
In other words, the disclosed technologies can drive in areas for which extremely large amounts of data have been collected and only so long as conditions have not changed. If a new traffic light or stop sign is installed, the self-driving car is likely to miss it.
There may be secret sauce in the lab, of course.
Presumably at some point we have cars that can legally operate fully autonomously (under some defined set of conditions) and the driver would not be expected to be in control. In that case, I'd expect in that scenario there would be a lawsuit naming the manufacturer among others.
What is the problem, here?
tldr; ".... Sacrificial dilemmas therefore tell us little about utilitarian decision-making". Paper proposes to "studying proto-utilitarian tendencies in everyday moral thinking" - seems a good option to choose.