There is a huge gap between Google testing a driverless car, with a person in it for emergencies, and actually seeing hordes of driverless taxis of trucks on our streets.
I can imagine a new trend with bored teenagers. Jump in front of the driverless car or truck and watch it emergency stop. Then run away. Or wait for the news report where all the driverless cars in the city have gone to the same car park because a hacker thought it would be hilarious. Just one truck accident that wipes out a few children and the trucks will be taken off the road. After all, if one truck has the bug then they all do. When a person makes a mistake we don't stop all trucks because we blame the person, when a software version crashes then they all could crash.