So Who Is Building That 100k GPU Cluster for XAI?
nextplatform.com
nextplatform.com
More impressive than that though is the 1000+ acres of empty land going south that is prepped for future industry. As a Memphian, I hope Elon sees the potential to build huge scale stuff here in the future. There’s a huge steel mill, a river terminal for direct access to oversized shipping, a wastewater plant next door, a large Valero oil refinery up the street, and a Canadian National intermodal facility down the road.
Literally everything one would need to build millions of robots or trucks or rocket engines or whatever.
https://maps.app.goo.gl/NuHUpg6CcndxyKHK9?g_st=com.google.ma...
Specifically, the XE9680 racks ( 8xH100 ). 100k H100 GPU, 300k B200 GPU, liquid cooled doors in the racks, 750 racks, and some other minor details.
It doesn't look like there are any moats to speak of.
With a 100k GPUs? I think not.
Nvidia shipped 150k+ to both meta and MS each JUST in 2023:
https://www.statista.com/statistics/1446564/nvidia-h100-gpu-...
Certainly puts him in the running though
If the goal is to create a bigger, faster, smarter version of OpenAI's GPT, then I'm not sure if this sounds even logical. The current crop of LLM models is just a Q&A hallucination filled chatbot which are way past their peak hype cycle. There is still no business model or killer product-market fit. I don't know what the investors are expecting, but they are more than willing to throw more than 6B dollars. So idk. °_°