If you are using a USB microphone (and/or webcam), you can effectively do that with one of these:
4-Port USB 3.0 Hub Power Switches https://www.amazon.com/gp/product/B00TPMEOYM
4-Port USB 3.0 Hub Power Switches https://www.amazon.com/gp/product/B00TPMEOYM
Although I wonder if the bios on this HP let's you disable it...
Windows/browser permissions don't have device level granularity AFAICT, so I can't allow access to only an external cam/mic, but I can disable the internal ones in the OS for full tinfoil hat compliance.
Most importantly off is actually off when a button cuts the power.