Why is it possible for a pilot to "fight" the autopilot? From my (layman's) point of view, it seems logical that either the pilot would be in control or the autopilot would be in control, but not both at the same time.
And once you accept that, then it's natural that there should be some play before one system disengages to favor the other. You don't want a sneeze to disable your autopilot.