I actually think the same thing (designed for Southern California only) about self driving cars. My car comes with a bunch of pointless sensors that beep nonsense at me incessantly until I give up and disable them. The lane assist goes bananas while I dodge ample potholes or drive around road construction, so I turn that off. But even the panic breaking constantly complains it is no longer working (indicated by an irritating beep) because some combination of salt, road splash and maybe sun has disabled it. Heck, the backup camera requires frequent wipe downs due to salt otherwise I can't see anything out of it but a muddy blur.
I've never owned a self driving car, but I suspect they'll just throw up their hands and tell you to deal with it in the event of any inclement weather. Which would be about half the time around here!