The easy solution to this idea is to have the guy inside the car (you know, the passenger) pick up in this case. He's right there - no latency problems. The difficulty is in correctly identifying an unresolved edge case with enough margin to brake safely and draw the attention of a distracted passenger.