I'm open to having my mind changed but I have not really experienced this extreme convenience in practice. The vast majority of things I plug a HDMI cable into either don't have speakers or if they do, the speakers are a bad quality afterthought.
In actual fact, what has been an extreme inconvenience is the OS thinking I want HDMI audio instead of whatever much higher-quality* alternative output I actually want to direct my audio to.
The only time I've ever gotten high-quality audio output over HDMI is via ARC, which says a lot about the need for HDMI audio...
* When I say "much higher-quality", I don't mean HDMI is a low-quality audio transport, I mean the HDMI output devices more often than not have inferior audio output to some other bluetooth / 3.5mm jack device I am using.