The census don’t, generally speaking, tend to believe statistics and facts. And the media will always spin a bad situation to boost their click through rates.
So, even though self driving cars may be 100% less prone to accidents (this is just an example), media headlines like “driver killed instantly when self driving car automatically steered into a wall without warning,” will cause the majority to push back and say they’re unsafe.