Support for PyTorch on ROCm is fairly good. I have built it from the dev branch without much trouble for all year. There has been ROCm CI even longer, my patch to print ROCm system information for bug reports was merged last week.

If you know where to look (i.e. it's public but unannounced) you can see that nightly wheels have been built for the last few days. So I would expect that some time between now and the Developer Day in November we'll see ROCm appear on PyTorch's "get started" page.