This works great, until...
You leave the pair of headphones with the dongle behind by mistake and spend the rest of the day frustrated because you have access to a perfectly good pair of headphones but no the dongle.
Or you stick to one primary pair of headphones and are frequently taking the dongle on and off making it even easier to misplace or leave behind.