If we replace autonomous cars with taxi drivers, we have the same agency problem...but it's not a question people consider troubling.
> A taxi rounds a blind corner on to an inner city railway crossing. Half a car's length across the rails is a small child who's fallen off their tricycle. A steaming locomotive is barreling down the track. If the driver breaks in time, your vehicle will stop short of the child but be torn to bits as its shuttles down the tracks in front of the train. If they maintain speed, you'll just make it past the train -- but the child is not likely to survive.