Note: that already exists, it's called Jukebox! https://openai.com/blog/jukebox/