> affordable commodity hardware, like a single server with 4x NVIDIA A6000 or 8x NVIDIA 3090 GPUs
I need to seriously revise my definition of affordable commodity hardware
I need to seriously revise my definition of affordable commodity hardware
If you can't afford a hamburger, your problems are likely not in compressing trillion-parameter models.