Thats a very human-centric viewpoint, understandably. A human driver can only see in one direction, and should be looking in the direction where things are happening the vast majority of the time. A self-driving car can see in all directions and in fact is looking in all directions at all times. Perhaps the rules will be updated at some point.