Another big negative I think is underconsidered is that a Google owned self driving car fleet will be absolutely plastered with video ads and physical user tracking if they dominate the market enough to get away with it.
Imagine those unmutable video ads that are increasingly common at gas stations, but running constantly inside the car.