> biggest GPU compute cluster in the world right now
This is wildly untrue, and most in industry know that. Unfortunately you won't have a source just like I won't, but just wanted to voice that you're way off here.
This is wildly untrue, and most in industry know that. Unfortunately you won't have a source just like I won't, but just wanted to voice that you're way off here.
Sure, we probably can't know for sure who has the biggest as they try to keep that under wraps for competition purposes, but it's definitely not "wildly untrue." A simple search will show that they have if not the biggest, damn near one of the biggest. Just a quick sample:
https://nvidianews.nvidia.com/news/spectrum-x-ethernet-netwo...
https://www.yahoo.com/tech/worlds-fastest-supercomputer-plea...
https://www.tomshardware.com/pc-components/gpus/elon-musk-to...
https://www.capacitymedia.com/article/musks-xais-colossus-cl...
But it ignores Amazon, Google and Microsoft/OpenAI being able to run training workloads across their entire clouds.
[0] https://nvidianews.nvidia.com/news/spectrum-x-ethernet-netwo...
Meta said they would expand their infrastructure to include 350k GPUs by the end of this year. But, my guess is they meant a collection of AI clusters not a singular large cluster. In the post where they mentioned this, they shared details on 2 clusters with 24k GPUs each.https://engineering.fb.com/2024/03/12/data-center-engineerin...
Huang is still a CEO trying to prop up his product. He'd tell you putting an RTX4090 in your bathroom to drive an LED screen mirror is unprecedented if it meant it got him more sales and more clout.
https://engineering.fb.com/2024/03/12/data-center-engineerin...
This doesn't account for inhouse silicon like Google where the comparison becomes less direct (different devices, multiple subgroups like DeepMind)