No, they will simply phase out manual cars. No big deal, it just means it will be almost impossible to crash, and that's a good thing.
It doesn't mean you won't be able to drive, but you'll be driving with a computer keeping watch over the road ahead and obstacles around you.
Put the car in auto mode and sit back... Most people will choose that. Those who prefer to drive themselves can do, but within limits. You couldn't for example deliberately crash into the back of someone. There won't be a setting to turn off to achieve an outcome whereby the car touches any other object. It just won't happen while you're driving on public roads. For example the computer will not let you cross over double lines at certain speeds, or accelerate too fast at busy intersections, and so on. But it may let you accelerate fast if it determines that doing so won't put anyone else at risk, and conditions are suitable etc. The algorithms controlling when the computer takes over will be clever enough to almost be invisible, and that's what will win people over.
Regulations will prevent car manufactures from making fully manual operated vehicles. Every car will be required to have automatic safety overrides for any action deemed to put the car at risk of impact with another object.
Everyone thought it would be people who override the computer, but it will be the computer who has the final say in the direction and speed of travel in a hazardous situation. I think car manufacturers and the public will LOVE the fact that driving is safer.
Any driverless car accidents will be statistically unlikely, and everyone will see this. Even when just one car crashes, it will be headline news each time, like commercial airline crashes are now. People continue to fly because accidents are rare.
So, the "right to drive" won't actually be taken away. Your right to put yourself and others in danger on public roads WILL be taken away. Have a cry, but then you'll need to get over it because 450 billion is significant.