Self driving is a difficult problem because you need to:
- Decipher the nature of the objects in the 3d space you are moving on.
- Predict how their physical relationship to your current position will change according to current timeline and intentions of these objects.
- Explore the plane of possible deviations for each of these objects and be able to react accordingly.