Fast LSTMs in PyTorch

Has anyone tried similar things with CompiledWrapper and XLA on Tensorflow? Is it even possible?

This is so awesome. Makes me really excited for the future of PyTorch—being able to define symbolic deriviatives in a python subset is super cool