I was inspired by your comment and took a look at Daniel's work.
Forked it and spent the day upgrade to Aesara (the maintained Theano fork) and python3.
Haven't fully trained/tested the model, but feel free to take a look: https://github.com/kpister/biaxial-rnn-music-composition