If you're interested in this, I highly recommend the author of EMACSPEAK's blog [1]. Very interesting, innovative stuff (at it least seems that way to me, I'm not an expert on TTS systems or anything).

[1] http://tvraman.github.io/emacspeak/blog/articles.html