How would it react to a roadway that's covered in several feet of water due to flooding (and poor road design)? Or sinkholes? One-way streets? Freeways which change directions at different times of day? Dirt roads? (Can we make it autonomously offroad?) How will it react during an earthquake or tornado? How will it react to a bicyclist running a red stoplight and into the car's path, when the car has a green light? When the car comes across kids playing football/street hockey/baseball in the street, will it stop for them? How far out of the way will the kids have to move before the car thinks it's safe to go past?
Will these cars have systems to react when they take damage?