> Do you trust the software to not have dangerous bugs?I trust it as much as you trust a car to not have dangerous mechanical problems.
The problem with software is that you can't look at it to see if it's worn, you can't hear if it's about to fail, and it's not regularly inspected by experts to see how it is behaving. Also as programmers we are aware of hidden bugs that can only show up under certain circumstances. It's only a matter of time until an overflow or off-by-one error kills people.
Car makers and engineers have a very good idea how dangerous certain parts of cars are, and they have been built over many years to mitigate those weaknesses. So you wouldn't expect, for example, the five nuts holding a wheel on to all fail at once.
We programmers know that there can be far less certainty with software.
Even worse, others here have posted about the terrible software practices that were exposed at some manufacturers, and the reluctance by Jeep to react until the ability to crash their cars remotely was exposed at Blackhat.
I think it all comes down to how much trust you have and where that trust lies.
In my hubris, I'm going to have as analog a car as I can, and hold out without as many these features as I can until all the beta software bugs are ironed out. For mechanical failures, it took us many painful years to get to where we are now.
I guess what I'm saying is that I trust myself to pay attention and stay in the lane using the steering wheel more than I trust our current technology not to get confused and kill me by steering wrong. The reward just seems much less than the risk to me for that (and other) features. I don't trust automatic emergency braking to not slam the brakes on at a time when it will kill me either.
What scares me most is the perverse incentives the car manufacturers have to cover up their shortcomings. They have shown exactly how little they can be trusted to be honest with things such as VW cheating on emissions, exploding tires, faulty airbags and many many coverups to avoid recalls, etc, etc.
Also the remote access that is more and more prevalent in cars today. Hackers gaining access to the drivetrain functions of cars remotely is super scary to me. And when that happens, it will happen for every one of those cars on the road.
A DDOS of the morning rush would be very interesting at best. At worst, as bad as any terrorist attack.
Would you trust your life to the stability and security of even a major company's servers? I wouldn't either. There needs to be a LOT of regulation around these things, I believe, and we as a society should be able to decide exactly what we will accept and what we won't.
At the very least there should be rules about exactly how the systems in cars can be networked, and the security around those connections. The jeep hack was through a remote firmware update to the radio unit I believe. There are no important enough reasons to have a remotely-accessible radio directly networked to the drivetrain computer in my opinion.
It can't just be move fast and break things when lives are at stake. Everything I've heard sounds like it's the wild west at the moment.