Didn't really use any of their code. I reimplemented their model in a new library called deeplearn.JS.
If the issue is indeed with the library, there's little I can do.
I will still try to find what the issue is but can't make promises. Sorry for the letdown!