Humans often drive in conditions were it's unsafe -- icy roads, dense fog, heavy rain, strong winds. We take the risk, and most times it's okay, except for the occasional pile-up on the highway.
But I don't think a "full self-driving" car refusing to drive in those conditions would be a deal breaker. I'd prefer it if autonomous vehicles were more conservative and just refused to drive in unsafe conditions.