ZeroSpeech Challenge 2019: TTS without T
zerospeech.com
zerospeech.com
https://zerospeech.com/2019/results.html
^ click on the green (+) to see details for each submission including audio samples reconstructed.
Finding the requisite voice acting skills, training for the voice in question, and then identifying a number and calling it is a lot of investment in time and money and resources. (voice actors aren't cheap, especially if you're asking them to defraud someone's grandparents)
But if this project is successful in being able to mimic a person's voice saying what ever you want it to say, then anyone hanging around a theme park could capture voice signatures, and relations, and then turn around and exploit the same for fraud without anyone else getting involved.
To me, that seems like it would open up a large attack surface that is currently poorly defended at best.