This is the main reason I haven't upgraded my headset that included a USB dongle.

I've been trying to use my Google pixel buds and it's the same garbage experience you're mentioning. Random disconnects, output/input device swapping, and if you're using MS Teams or a video game that controls the devices it's a nightmare...