Still can't run GPT-3 or even GPT-J locally though, which is what the article is about. Learning takes a whole datacenter with actual terabytes loaded into VRAM, sure, but even running it requires you to have enough space on the card to actually load the model. Which is usually still in the 20G+ range.

Stable diffusion is about the only one of these useful groundbreaking models that can run on normal hardware to some extent, and even that's extremely limited with only like what, 256x256 being possible with a 6G card and 512x512 on a 10G card? So thanks for pointing out the one partial exception.