Since you would be learning from another AI and not humans, there would be much less variation in the way words are pronounced and you would have a lot more data.
What's the goal? What would be the benefit of training on a single TTS speaker
To have your own AWS TTS, which you can run offline and for free.