nice, i worked on something similar some years ago but this seems more sophisticated. i had a lot of difficulty with atonal sounds especially because i was trying to take a kind of "neural wavetable" approach, but overall i found the results intriguing nonetheless. curious to check out more recent efforts. i recall the DDSP paper and assumed those ideas would apply quite nicely to this problem.