This is not my experience. My M1 Pro MacBook has very strange issues with sound over HDMI. I usually need to reboot it when I connect it to my TV or media won't play if the sound is output over HDMI.
For me, I have an M2 and no issues. Was worried about v1 issues (same for VisionPro—will wait until v2)