Naturally you should design your systems for maximum efficiency, but since operating expenses are closely approximated by power consumption you are already correctly incentivized to do so.
Naturally you should design your systems for maximum efficiency, but since operating expenses are closely approximated by power consumption you are already correctly incentivized to do so.
As you mention, DC operators are already highly incentivized to reduce energy costs, so as wind and solar power continue to drop in costs DC operators will want to fund or buy green power as often as possible.
Getting backup power to be carbon neutral will be a little more challenging in a DC, but it's a walk in the park compared to many sectors. Shelf-stable biofuel is already fairly accessible and using grid scale batteries can reduce the need to combust anything (plus open power arbitrage opportunities).
Can you prove this assertion? The first page of Google results indicates energy is a greater cost than labor, with figures ranging from 60-70 percent of total operating costs.
(i owned a small web hosting company in the early 00s, and am somewhat familiar with the per sq ft cost model of colos and datacenters in general, having had to contract for space and perform part of the buildout myself)
The general disinterest in performance/efficiency work even for large scale datacenters is a major theme of Dan Luu’s writing. I’m not sure how that applies to the rest of the industry but I can attest that my company’s performance engineering team has been zeroed in every round of layoffs we’ve ever had.
The biggest players are running highly, highly efficient software.
As long as the industry is growing (it is), the opportunity cost will be high. It seems more likely it's the opposite of a self correcting problem. My 2 cents.
That doesn't necessarily mean management doesn't care about efficiency and performance, it just means they don't value the performance team (right or wrong).
When they gave up, they concluded that AWS's core advantage was their optimization of the electricity needed for cooling. Given that my friend's company failed to design their systems to heavily optimize for this, the cost of electricity for cooling alone didn't let them get near AWS prices without incurring significant losses. He said that if they did it again, every part of the product would have a strict heat budget.
Maybe your personal experience differs because you were not operating at scale? Larger scale means better negotiating over power / colo costs.
Hyperscalers in particular currently can’t scale out very easily necessarily because many of the DCs have hit local power restrictions so compute power efficiency and density are the primary means to grow capacity. Think apartments in skyscrapers v row houses. So electricity _efficiency_ is what is being sought rather than just pure operational costs of the DCs.
I’m the northern Virginia exurbs hyperscalers have bought out so much of the land it’s now perhaps greater land use than family farms there and starting to encroach upon housing developments. Locals also complain about the noise (there’s a sort of hum from the sheer mass of air and whirring fans) from DCs impacting health. Some areas have been reporting increased rates of hearing disabilities although I can’t recall a study being conducted yet.
In popular siting locations like Ireland, the local power grid is struggling. Data centers make up 18% of Irish electricity consumption: https://www.euronews.com/green/2023/06/13/data-centres-gobbl...
In developing countries like India where the power grid is not stable, to maintain DC uptime you probably need backup generation, which is very expensive very fast.
Are we really making more efficient systems if they take 100x the compute to fulfill the same transaction.
Just the power consumption in browsers... Thanks node.