It has to be a nerve-wracking job when a bug in your code / algo can cause deaths.
If the system is heavily based on machine learning, there may be no such code bugs or algorithmic mistakes to find, no easy way to show exactly what went wrong and why a fix will prevent it from happening again.