As of the latest iPhone 6, you don't even need to have the iPhone plugged. You trained Siri a few times by saying a few sentences and later you can say "hey Siri" and it will start listening.
Apple added some new chip which will be listening for that key sentence and will only react to your voice, not someone else.
So no more funny joke from co-worker nor Podcast and in addition low battery impact.