And there's a huge increase (apparently around 36%) in road fatalities during bad weather.

People have much higher safety standards for self-driving cars than they do for human drivers. Just look at how one fatality led to the total abandonment of both the Cruise and the Uber self-driving program.