You can also remove the Siri icon and add a Play/Stop icon to the default icons on the right. Go to System Preferences -> Keyboard -> Customise Control Strip. You can then move your cursor down off the screen onto the Touchbar, drag Siri out of the way, then drag a Play/Stop icon down into the Control Strip.
Then it will always be there even if the control strip is contracted rather than expanded.
I don't like the Touch Bar, but I've grown to hate it less. However it does register unintentional presses regularly. And no, I'm not "using it wrong".