See also module music. MIDI + SoundFonts would be a reasonable idea for music and sound effects, but it wouldn't be suitable for voice.

Something like Vocaloid parameters would be interesting, but the synthesis engine is probably pretty intensive.

(To be clear, I think this is an idea that's fun to think about as a novelty but probably a dead end otherwise.)