You can compile PyTorch this pretty easily, I wrote a recipe here:

https://lernapparat.de/pytorch-rocm/

No docker involved, just Debian + the ROCm packages from their repository.

I'm doing this relatively regularly, and it has worked well for me for the past half year or so.

I guess I could upload wheels somewhere, but I'm never sure how tight the dependency on ROCm has to be.

Over the last release cycle, PyTorch/ROCm gained support for TorchVision including GPU ops among other things (based on support for extension compiled via setup.py). Master has support for loading extensions that are compiled just in time.

If you find things not working as well as they should, don't hesitate to tag me on a bug report or send a mail.

(The PyTorch/ROCm is mostly for my own entertainment, so I don't speak for anyone.)