>What to do with all that computing power now. I guess AI.

For AI, the lack of memory is pretty limiting.

Having a ton of 8 GB or 10 GB memory GPUs (3070/3080) is annoying and often just not even possible to use effectively without designing specifically to it. If they get really really cheap maybe they'll be some tools or models that are built to leverage scenarios like that, it's not impossible, but for now it's probably just the cheap 3090s (24GB of memory) that will benefit AI.