You personally wouldn't be upset at all if a loved one died to a bug in the software that caused the self-driving car to make an obvious mistake that the loved one would never in a million years have made themselves?
I can see how people can have concerns at least, when control it taken away.