Personal experience: It's not even worth it. AMD (i)GPU breaks with every pytorch, ROCm, xformers, or ollama updates. You'll sleep more compfortably at night.
When dealing with ROCM, it's critical that once you have a working configuration, you freeze everything in place (except your application). Docker is one way to achieve this if your host machine is subject to kernel or package updates
I don't really have any problem with ROCm these days, although I only use system packages. It used to be quite wonky though, and I've totally given up on custom ROCm installs.
Same here on my 7900 XTX. Used to be terrible, now it's (seemingly) fine (for now).
Thats our observation, which is why we wrote the scripts ourselves that way we can control the dependencies at least.
It's not the experience I have. I've been using ollama for 6 months on mine and never had any issues with ROCm breaking.