No, it doesn't. Self-driving cars are potential substitutes for human-driven cars. If self-driving cars cause fewer injuries/accidents/etc. per mile driven, then everyone will be safer if we replace human-driven cars with them. If you object to self-driving cars being on the road even if they're safer than human-driven cars, you are implicitly saying that your preference is for more people to be injured.