I agree. In fact I built my own music player to support this on Mac because I wasn't happy with the existing apps:

https://www.plastaq.com/minimoon