From what I understand of the technology at play here, it seems like it could be defeated by a pair of earplugs (or, if you're in a conversation rather than a speech, then a microphone/headphone combination with an additional short delay) - though I'm by no means qualified in this area!
Still, even if there is a workaround, it seems impractical to wear all the time.