What would be the point of self-driving cars which were no safer than the status quo? That's just removing freedom from drivers and adding more complexity to infrastructure for no added benefit.
It's also exactly the narrative that proponents of self-driving cars have been driving (pun intended), self-driving cars would eliminate all, if not nearly all, accidents and fatalities.