Transformer-XL: Unleashing the Potential of Attention Models

How well does it do? Would you have a link?

That comment complains that the model is not useful for compression, because it stores all that linguistic knowledge in the 3GB of model weights. But for NLP applications, you want the model to store as much information as possible, and it only matters whether it generalizes to unseen data or not. The compression measurement is just to show that, not to imply that the model would be useful as a general-purpose compression algorithm.