Personally I think changing the volume dynamically like that would destroy the music.

And there's a simpler solution to your problem: intra-ear monitors (IEMs).