That's right. Some day I hope, and believe, that the average consumer actually won't be able to manually operate their vehicle (edge cases aside). I love to drive but there are some true idiots that we share the road with. I'd gladly give up my right to drive, if it meant those idiots also lost theirs. You will require some specialized license to do so, which would require passing some stringent checks.
So that's how I can see it being dealt with in the future. But the early stages? That's a very interesting question and one which I don't have any idea for.