Never. In fact, the annoyances of the occasional helpful "Are you trying to use Siri?" pop-up motivated me to turn it off.