Synthesizer V Pro is a really interesting tool that does something similar to this. Right now it has very limited voice banks, but the ones they have are pretty crazy in their capabilities.
https://store.dreamtonics.com/product/solaria-voice-database...
(Of course right now you can only use voice banks they've pre-trained, but I bet in a few years you could fine tune it on recordings of your own voice)