If other controls are being actively engaged by the pilot, the need for the button press would be delayed only until there's some continuous period of non-engagement.