You barely even need NN for this - it's basically pathfinding.
Find the path to where you want to go, avoid the parts with negative weights.
Find the path to where you want to go, avoid the parts with negative weights.
Again, the hard part is not "here is a human, avoid it". That part is done (in Waymo's case).