You can pull the power button to switch between devices the headphones are paired to.

I've instead found it useful to disable the voice prompts. The connects/disconnects become a short beep that doesn't drown out anything else.