Very interesting! Is there a preprint or demo that you forgot to link to? Will you be releasing source or data?
I'm wondering what the hardware requirements would be for real-time synthesis. I work on a musical instrument project as a hobby and would like a good accordion sound.