> It would be useful to know if PyTorch runs faster or slower than their methods using their sparsified matrix techniques.

Probably not an easy feat. Sparse support in pytorch is minimal.