1. If you judge new technology by the absolute worst way that it can be used, you are going to spend your life worrying about a million things that will never happen. Focus on stuff that's happening instead of hypotheticals.
2. In a really dystopian setup, you can be restricted from leaving "your zone" regardless of autonomous vehicles. There's plenty of existing technology that can help with that. (number plates, cellular networks, facial recognition, etc.)
Like cameras and AI used to enforce the “not allowed to sing while driving” policy for Amazon drivers?
The only way to make sure things never happen is by worrying about the worst possible misuse of the technology. Because someone will misuse it that way if it gets him money or power.
I'm not saying to be naive to possibilities, especially as they begin to move from the "possibilities" bucket to the "realities" bucket, but isn't it better to focus on making progress against stuff that's already happening? If Amazon are preventing drivers from singing, I think those drivers might be able to change that.
How do you prevent "hypotheticals" from becoming "stuff that's happening" if you never pay any attention to them in the first place and let them happen?
Once it's starts happening, speak; if speaking doesn't work, fight; if fighting doesn't work, move. This works.