Yup. Humans are allowed to make mistakes and fail fatally. If self-driving cars make a single fatal mistake, then watch out for negative press coverage for weeks. Why? Because every failure can be traced back to a root cause. Every root cause (other than something like another driver literally trying to kill you) looks like an incompetent screw-up after peeling back all the layers. In principle, self-driving cars are basically perfectly safe (as a system). So every failure causes righteous fingerpointing.
...which is also partly the motivation to improve.
I expect self-driving cars long-term to be a lot like air travel. It'll have a reputation for being super unsafe, with lots of people paranoid of it, for decades after it has far eclipsed the safety of regular human car driving. The paranoid hyper-focus and ridiculous press coverage is also what will enable it to become essentially perfect (like passenger air travel is today in the developed world).