For me on PulseAudio it consistently switched it as expected, however, it the selected audio profile was quite random.