It cuts both ways. You're not wrong, and yet atrocities frequently depend on people following orders, which is something that only an unreasonable person won't do.

Basically, for good or ill, history pivots around the unreasonable people. The reasonable ones might be bystanders or accomplices, but in either case, going with the flow is simply the reasonable thing to do.