> If I'm going the speed limit, and a pedestrian on the sidewalk 6 inches away from me [...] decides to step in front of me
Which she presumably had to do to avoid the oncoming double stroller without diving into the pile of trash bags awaiting pickup.
I disagree with the GP, this isn't merely about penalties for drivers. We've allocated an inordinate portion of available space to large metal vehicles carrying just one or two humans each, and left the scraps to be shared between all pedestrians, skateboarders, outdoor restaurants, parking meters, trash bags, trees, and all manner of other things. Because of course, you can't put the trees in the middle of the street, what would all the cars do? And then the pedestrians also spend 20% of their time waiting at traffic lights that are only necessary because cars are death machines that can't stop quickly enough.
The fact that avoiding an accident "would require [you] to have a negative reaction time" is exactly why cars are inappropriate for busy city centers.