Tract supports ONNX models, which you can export from pytorch. See nnsplit[0] as an example for a project that trains with pytorch and serves the model via tract-onnx.
You can also export them from LightGBM and XGBoost (see sklearn-onnx) for forests and tract will handle them! // well, almost... I need to finally find some time and finish my tract PR :)
We were unable to get Tract to work at $job but there's another project, I think called onnxruntime-rs that we did get working with our models.
Tract looks incredible, I am surprised that it can support Wavenet on the Raspberry Pi Zero.