Rocm hasn't been the the problem in my experience. It's things like pytorch on rocm. It uses hippify to convert cuda code to hip rather than having native support.

It "works", but it's an obvious second class citizen, and the developers don't seem to take bug reports / PRs seriously.