At some point we're going to have an entirely new field of study specifically for this situation. I propose the name "Quantitative Philosophy". The goal is to merge AI research, philosophy and law to determine the "correct" choice in complicated situations when the agent of action has time to consider all possibilities.
Without a by-in from academia, law, legislatures and society as a whole, any action Mercedes takes in this situation will get them in trouble. In addition, we could either see premature or delayed adoption of AI.