I guess one answer could be to add a physical switch to disconnect microphone, or use a removable microphone.