Everybody deserves freedom of movement regardless of how smart you think they are.
You are free to take the bus or ride a bike if one is incapable of driving safely. The rest of society isn't forced to suffer.
Or having someone competent drive you. There isn’t a right to travel anywhere in the world at the speed of your choosing – someone who is unwilling to drive responsibly shouldn’t be allowed to endanger everyone else because they don’t want to find a ride.
I'm explaining why the safety of driving vs flying are so different. And the reason is that any moron is allowed to drive.