While working at Cruise, i built tech to measure the latency even though they just draw a path. Latency absolutely does matter, otherwise you’re drawing that path through a crowd of people. You admit yourself they still need to be responsible for collisions, which you cannot safely do if the latency exceeds the safe tolerance. It doesn’t matter whether you’re drawing a path or turning a Mario kart steering wheel if the information you’re acting upon is incorrect or outdated.