Doesn't happen on iOS though, which leads me to think it must be a limitation of the Bluetooth hardware in Macs but not in iPhones and iPads?
As soon as the headset is told to turn on the mic, quality drops significantly.
I figured it was by design, and using a better codec/more bandwidth whenever it could afford to, but dropping down to half that in order to run the mic channel side by side.