Hacker News Reader

Comment by mynti | Hacker News Reader

The tech has always been mature enough but simply too expensive. But since combustion engines are sold out for the next years, data centers are rushing to get anything they can. So the extra millions for power generation will be a rounding error

View on HN

I would think someone would have run those numbers first.

No time to think, go go go.

You would think, right?

If the numbers dont add up it's fucked anyways who cares just send it

Also worst comes to worst government will have to bail them out to not cause massive unrest

someone did, determined it would make them look bad, and pawned the assignment off to a junior executive to take the blame.

if it works then they delegated successfully and the project is winning and if not then they blame the neophyte VP and walk away with another quarterly bonus anyway.

Electricity is about 3% of their total operating cost, so, yes.

Electricity is only 3% of opex for a data centre?

That seems surprising - source? What's the other 97%? Does this include ops staff?

Without having done any research at this point I would assume it's mostly the amortized cost of hardware - GPUs, memory etc

That's capex not opex!

The stuff inside the buildings (servers, switches, storage, cooling, etc) basically the stuff using the electricity and salaries/sub contractors (in addition to some techs handling the servers think security, cleaning, storage management, receiving shipments of new hardware, etc). Some taxes (depends a lot where)

I saw a breakdown (don't have on hand sorry) where server depreciation was by far the majority. Power was the largest cash opex, probably matching your intuition.

The cost of electricity is (almost) negligible compared to the cost of having GPUs sitting idle. Electricity from fuel cells can be twice as expensive, but even then, it represents only about an extra ~15% of the amortization cost associated with keeping the GPU hardware idle.

That's not an operating cost, it's capital cost.

Yes, but given the 3-5 year lifespan of the server infra capex, the separation becomes less meaningful. Better to count the entire TCO or discounted cashflow accounting for the rapid asset depreciation.

There is no way it's 3% if they're getting electricity from the grid, even if they get their cooling from somewhere else (eg lake/river water or outside air in winter). Median DCs are anywhere from 25-40% (depending on the jurisdiction's electricity costs and how much cooling they need). Hypercaler datacenters tend to be even more dense than the median traditional ones.

Energy is the largest OPEX by far (70-80%)... taxes second.

https://epoch.ai/data-insights/ai-datacenter-cost-breakdown

Anyone who puts a local model on a GPU understands how much heat they produce.

Its amusing watching cloud AI users struggle to grasp even direct impacts of their use.

That's if you don't count hardware amortization - which is 80% of the cost...

That's not OPEX, that's CAPEX and tangible assets are depreicated not amortized.

Reply on news.ycombinator.com