I wish someone would make the latter much easier, as someone who is definitely not the only person to get interested in this AI stuff lately who has a high tier AMD card that could surely do this stuff and would like to run this stuff locally for various reasons.

Currently I've given up and use runpod, but still...