How does a self driving car differentiate between a police officer flagging you down and a carjacker? Humans can make this judgement because we have a context for each of those situations based on our understanding of how the world works outside of just operating a vehicle safely.