Hacker News Reader

Probably no 4-bit quantization support? Or they are missing some ops that the tensor core cards have?

My guess is AMD users will eventually get low VRAM compatibility through Vulkan ports (like SHARK/Torch MLIR or Apache TVM).

Then again, the existing Vulkan ports were kinda obscure and unused with SD 1.5/2.1

You will want an optimized implementation from torch-mlir or apache tvm anyway.

We had this for SD 1.5, but it always stayed obscure and unpopular for some reason... I hope its different this time around.

Your 6700XT won't work anyway, since its not supported by ROCm

The 6000 series "unofficially" works with rocm, and that is hopefully getting more official.

It works on my 6900XT with ROCm

Because anything higher the 6800 is unofficially supported

That's not accurate, I was able to make my old RX 5500XT work with ROCm some months ago, only after 6 hours of compilation process though...

Its not supported, only navi 21 is supported, which is RX 6800+