Now if only I could afford 8 RTX PRO 6000's
Sure, let me just buy $60,000 worth of GPUs to run a *quantized non-frontier model*.
For that price you could:
- put a down payment on a home in a large % of the US
- buy a brand new car in cash (possibly two!)
- take a long sabbatical and travel the world
- pay all 4 years or your child's college tuition
The topic of the story is running 8x RTX PRO 6000s, so whining about how much they cost or what you could/should buy instead is completely off-topic.