AMD Radeon RX 7600 XT Linux Performance
phoronix.com
phoronix.com
That's potentially compelling.
I'd love to see benchmarks and compatibility for PyTorch, llama, Stable Diffusion, etc. I assume it's still a train wreck, but if AMD can get it's software stack in shape, that'd be very, very competitive.
I played a lot of War Thunder on Devuan (Debian minus systemd) through Steam.
Up till last year, I owned an nVidia 1080Ti. Performance in Linux was quite good, but I had crash after crash in War Thunder - Gaijin blamed nVidia for the bug, nVidia blamed Gaijin. End result was it remains crashy. Closed-source, so nobody who really cares can look. The crashes were so frustrating I decided to go AMD. nVidia driver updates are sometimes a crapshoot, most times it works fine, but every now and again the update results in a broken Xorg which is a PITA to fix, heaven help you if you get a mix of the nouveau and the official drivers.
Last year, I bought an AMD 6700XT as the prices dropped. I chose the 6700XT as it seemed like the best performance at the lowest power/cooling requirement.
Gaming has been flawless with just the in-kernel drivers using RADV. No addon software stack required, "it just works". I play a lot of games using Proton/Steam, so if issues were going to pop up, it would be there. I had some initial confusion as I thought I'd need to download the drivers from AMD, but as it turns out everything works great in kernel 6.x automatically provided you have the non-free firmware packages installed.
I am running Fedora w/ Wayland.
Needs a few start arguments (--lowvram --precision full --no-half --skip-torch-cuda-test). YMMV.
GPT4All also works well for LLML on AMD.
1) The BIG tools have SOME port to AMD. I am confident that one can run Mistral or SD in some framework there.
2) It's a port. If you want to do anything bleeding edge, development, niche, or similar, it's a dumpster fire.
I do dome amount of development which uses LLMs. I want to be able to use a model directly from Hugging Face and have it just work.
DirectML is fully supported path on Windows and is support by Microsoft et al. (https://github.com/microsoft/DirectML).
Everyone is moving off Cuda as quickly as possible not because the other are better, per se, but because it is easier and cheaper.
Wendell from level1techs/level1linux has shown the 7600XT as a good cheap AI card due to it's higher VRAM compared to other similar cards.
The review is very favorable as a decent card for linux users: https://www.youtube.com/watch?v=phJVjfGQAyI
General dev usage nothing AI though.