I'm danged if I'd let it get so close to disaster if I was recreating this. One tug of the steering wheel in the wrong direction is enough for me to assert myself and get the car to cancel Autopilot.