It seems that we've learned over the last few years that a big part of getting a robot to operate in an unstructured environment is contextual understanding. Example - a woman fell under a Cruise car recently in SF and the car ran over her leg. The car correctly guessed that something was wrong, but it did the wrong thing in that context. It stopped on top of her leg and pinned her under the vehicle.