No I'm very serious: we are unable to protect smart TVs. Networked smart cars (because let's be real - Google and co. would want to monetize this with Uber-like services, Ads in cars etc.) are a magnitude more likely to be hacked by both the state actors and rogue individuals (altho I don't see why we make this distinction...both are criminal acts).
The worst that can happen if your smart tv is hacked, is that they can listen and maybe watch you in your living room. If your car is hacked, they can probably kill you and hurt others while they are at it. If this happens on a large scale, it's extremely dangerous.
So while I have no problems with self driving in itself (or with Google for that matter of fact), I have a problem with banning human driving cars on the road without a viable (non-intrusive) alternative.