To my understanding - WaveNet itself is quite resource heavy to run see this thread: https://news.ycombinator.com/item?id=12501204

I'm looking forward to seeing faster implementations in the future, playing around with this looks like a lot of fun.