Waymo is going at this right. They sense as much as they can, build a detailed 3D model of the world, and only use machine learning to help classify objects. Classifier failures aren't too serious; the obstacle still gets avoided, but you might not get as smooth a ride as the behavior prediction won't be as good. Compare Tesla's self-driving videos.
[1] https://www.ted.com/talks/chris_urmson_how_a_driverless_car_...