We have lanes for carpooling - why not lanes for autonomous vehicles? The road surface could have special markers to centre the vehicle, and to position it in the correct lane for a certain destination. This could be a single lane in a highway, with shorter distances between cars (relying on the quicker reaction speeds of computers and the modern, well-maintained brakes of the cars themselves), allowing humans to overtake and recognise them easily.
Then we need a standard method of communication between vehicles - braking, movement etc. - rather than relying on cameras and radar.
Remove as many variables as possible and the task becomes much easier.
Heck, we'll need a new method of charging road users for road use, without gas taxes, so we might as well introduce a standardised road pricing scheme as well (that takes into account vehicle size, weight, time, and location to calculate the price/km - and can communicate that to the end-user to allow them to optimise their travel).