I switched to AirPods (Pros and Max) and a lot of my issues dissapeared.
Honestly it's a shame because the audio quality on the XM3 was better than the Airpod Pro but the software is just not there.
The AirPods aren't perfect either of course, but it's a night and day difference between the reliability of them vs the Sony.
I found the Sony was extra bad when there was either a busy area or if I took out just one ear. Often I'd start dropping connectivity to one ear and then they'd just crap out altogether till I reset them.