Hacker News Reader

Right? How do people not understand this? Have fun with your super-high latency when the DCs leave your city.

It’s not necessarily “super high” latency to connect to data centers at a distance. Whether or not it matters depends on the application, and for most consumer applications it isn’t a huge issue. For AI data centers it doesn’t really matter.

The signal speed in fiber is some 200k km/s. If you go 10 miles outside of a city, you are adding 0.1ms ping, and you will have dramatically fewer pitch forks.

The ping between New York and LA is ~70msec. Chatting with a LLM is not latency sensitive.

Is this DC even for LLMs? I've not seen any sign of that.

Considering that the initial build out was only 10MW, it seems unlikely that was the primary usecase.

But if it’s a colo it’s unlikely to have many LLMs running there. The big AI datacenters are mostly purpose built.

Reply on news.ycombinator.com