Here is a pretty good paper on the topic, albeit a bit older so some parameters might have changed slightly.
317 karma · joined November 23, 2018
Here is a pretty good paper on the topic, albeit a bit older so some parameters might have changed slightly.
It's hard to find current numbers, but capital investment for combined cycle natural gas plants seems to be about a tenth of modern reactor projects in western countries.
Apart from insulation energy required for heating changes massively with local climate and scales directly with living space. So directly comparing those numbers without additional information is quite meaningless.
Here in Germany, which seems to have a roughly similar climate, ~120kwh/m2 and year is the average for a detached home. Modern buildings are usually a lot less though, 30-50 kWh/m2year seems standard. With specialised construction ('passive house') and heatpumps 10 kWh/m2year is well feasible.
And natural gas, which usually covers the more elastic power demands is dramatically more expensive.
Double precision is important for a lot of simulation codes because of numerical issues. For Deep learning applications it's basically unused, single precision or half precision formats dominate training. The same numerical issues don't show up, so this is a lot more efficient.
Additionally a lot of the 'AI' flops are achieved through matrix cores, fitting Deep learning the workload well. This brings an A100 from only 17 to ~200 tflops.
> But can a 10-node-iphone-cluster really match an A100 for pure flops?!
The iphone number is probably fp32 if not lower precision. However the combined SoCs of 10 iphones have tripple the transistor count and a larger chip area among them. So the comparison is not totally off.
In fact if you look through the historic top500 lists a lot of the space outside the top10 is occupied by industry clusters. Classically oil and gas has been one of the big consumers. In recent years there are more and more cloud clusters in there as well.
So this Tesla cluster isn't really anything unusual.
There is the AAPowerLink project which proposes exactly this. It's a ~20GW solar farm in Australia with battery storage and a 4500km HVDC undersea cable to export power to Singapore. Seems currently in a planning and Project seems to be in a planning and exploration stage with funding not fully secured though.
This is the case for some stations, e.g. Berlin Hbf or Dresden Hbf. Anecdotally I've never experienced delays due to waiting in front of the station there, unlike e.g. Hamburg or Hannover where platforms are shared.
Intels upcomming Saphire Rapid server CPUs are extremly similar, with wide connections between two close dies. Crossectional bandwith is in the same order of magnitude there.
Especially the GTAV dataset is often used as a synthetic dataset for research. The appeal is that you can extract normal/material and other semantic information from the game engine for a driving scene.
Basically avoid expensive segmentation labels on real data by working the other way around. Things like this synthetic to real translation can then be used for other downstream tasks (semantic segmentation, distance/normal prediction).
Those standards obviously have their benefits or are unavoidable (fire protection) and result in new housing being high quality. But they make it hard to address housing shortages in a non long term way.
However the previous cpu emulator apparently emitted .Net byte code and used RyuJIT (the .Net jit) to emit the final native code.
> if it's running on an ARM processor does it just run the instructions directly?
So maybe? There are some passes in between but one would think it would at least result in very similar instructions.
HVDC of course has the disadvantage of extra conversion equipment. HV circuit breakers are also significantly more complex as an arc will form as long as current is flowing. With AC this happens at the zero automatically, nothing like this with DC.
What you are describing would work as an analogy for hyperthreading / smt though. Not all ressources are used because one needs to wait for things to be ready. So you do something else to keep busy in the same space as the rest of your kitchen.
Below 49Hz larger consumers would be cut off in steps of ~10% of the network load. AFAIK this includes large industrial consumers who are legally required to have the equipment in place to allow for that.
Correct me if I'm wrong, but is this actually different from regular integrated graphics that have been in intel and amd chips for decades? I remember there being some initiatives from amd proposing similar offloading under the name HSA almost a decade ago. I don't think there are actually any software really using it.
Running things on some accelerator (gpu, etc.) usually involves writing a specific kernel in a language subset, manually copying data and generally long latencies. Unless there is a lot of data it won't be faster.
With AVX in the best case the compiler can just vectorize some loop, speeding it up 5x without any added latency or source code changes.
With nerfs you get an actual volume representation with a mapping from every point in 3d space to whether it's inside a volume or not. It's an actual 3d model instead of a 2d image with a depth channel.