Stupid question: can't you just turn it off? Does it emit signals / identifying information while it's off?
Realistically, if your adversaries are capable of communicating with your phone while it's turned off or in airplane mode, your best solution is probably just to hit your phone with a five dollar wrench until it breaks.