Maybe maemo with modern ofono (derived from mer?) Would work on pinephone.

Maybe megous has a better idea, but I believe bt requires keeping the wifi radio powered as well? Is there something that could be done at the driver level to separate the power domains?

Maybe using mpd and disabling the UI when you don't need it will help. Most of the gnome players use gstreamer and trigger constant events in their UI.