Respond in English, yes. Will they simultaneously be annoyed? Yes.
Also, 90% chance the English will be sub-standard (just to clarify, I am a 36 year-old Frenchman and I know for a fact that my average fellow citizen's command of the English language is rather poor).