Tell that to a pilot who's had an autopilot failure where a servo went crazy all of a sudden. You better act quick, especially in low visibility situations, to turn it off, or pull the circuit breaker.
It might happen a bit slower than in a car, but the consequences can be much more dramatic.