i'm honestly surprised HF doesn't have this feature yet, very useful! will you publish the code on github?
any plans on adding more consumer-grade gpus?
any plans on adding more consumer-grade gpus?
I've added the 4090 and 5090 as well now, make sure to get version 0.5 of the extension