Best kept secret in the AI boom really is that you don't need a ton of local horsepower to run a model and do something useful, you only really need the grunt once, to do the training in a reasonable amount of time.
Combine that with the stuff that Mythic was working on in texas (before they ran out of burn) and we're looking at a world where, most people won't have a need for heavy GPU compute.