Intel is all-in on backside power delivery
spectrum.ieee.org
spectrum.ieee.org
Reading on my phone using Firefox with adblockers. Why are you using no adblockers.
One of the wild things to me is how incredibly elaborate chipmaking as become over the years. Per Wikipedia, the 6502's layout was made with "a very manual process done with color pencils and vellum paper". That's the processor that launched the personal computing revolution, powering the Apple II, Commodore PET and VIC-20, the Acorn, and the BBC Micro. Nearly 50 years later, things have gotten so fiendishly complex that "flip it over and put some stuff on the back" is a major industry change requiring who knows how many billions in R&D.
Is not a true statement.
And this sad state of affairs shows no sign of evolving favorably. Closed-source software and corporate interests at their finest.
I don’t really think chip making is much like that. I wouldn’t say that chip making was the first industry to be automated by computers either.
P.s. in case you never heard of BPD technology, https://semiengineering.com/challenges-in-backside-power-del... is also informative (thanks @rektide for the Anand link!)
Edit:
Relevant quote from TFA which somewhat answers the above question:
> Of note, because the carrier wafer is on the signal side of the chip, this means it presents another layer of material between the transistors and the cooler. Intel’s techniques to improve heat transfer take this into account, but for PC enthusiasts accustomed to transistors at the top of their chip, this is going to be a significant change.
TL;DR: No.
Intel's implementation has other factors, as discussed in the Anandtech article. Normally there's a fairly thick silicon base underneath the transistor layer, but Intel polishes that away to nearly nothing after the frontside signal wire layers are put down (to make hooking up the backside power easier). That greatly reduced structural strength & is a somewhat taxing process, so before doing the polishing down, they put a carrier wafer atop the frontside signal wire layers, adding some structural strength. And there it stays.
Which means now that the top of the chip has a carrier wafer just for structure. Then the signal wire layers. Then the transistor layer with a bunch of PowerVias also in it. Then the backside power layer.
In the first sample chip, there's still a quite a few signal layers, 14, Vs 15 on other chips. Only down by 1. But better chip utilization and other benefits (ir droop). The backside is 4 layer. Maybe maybe the backside power delivery might have (or maybe could someday) greatly let them cut down on the number of wire layers, which are all now between the transistors & the heatsink. But not yet. So there's a significant number of layers of things burying the transistors now.
None the less, the thermals here looked fine.
It's a great article.
If not, I would intuitively think this whole approach would fail?
You might want to read this: https://en.wikipedia.org/wiki/Design_for_testing
This process is automated, and for a given chip you might have a few gigabytes of stimulus total, which can collectively identify a single failed transistor (and kick that part out of the batch).
Now, I have no idea how you take a picture of a bad transistor. That's beyond me.
Or why you would want to.
Seriously? The chip is inside a carrier but enthusiasts care which side the transistors are on? Absurd.
This is may be to there benefit, as it gives them another 5 years to say “oh we’ll be ahead soon” without actually releasing anything.
Intel has put out some interesting chips in the last couple years. Anyway, their dominant years set a pretty high bar, I don’t think we’ll see that again (I guess the aliens decided to start spreading around the technology they send).
That said, if there's a person built for this job, Gelsinger is him. Life's better when this industry has competition.
Absolutely. Yes. I was surprised how well he did during his time as CEO. Considering he is a Finance and MBA Guy.
It's more to do with a deeply dysfunctional and arrogant organization from top to bottom due to many factors, one of them being having the market "cornered" for the previous ~10 years.
They're spending astronomical amounts of money on R&D and capex.
They're "all-in" on multiple strategic directions.
It appears to be positive now, or at least it isn’t greyed out anymore. I wouldn’t wonder too much about these temporarily downvotes comments, they usually bounce back pretty quick if they are any good.
Can a lower level of 'scale' be used, to achieve the power lines, and so more assured/fault-tolerant production?
If it has to lock-step the generational burdens of masking and technology, and is unable to capitalise otherwise unused silicon, it doubles costs in those inputs. Not that it doesn't mean it can't deliver both improved power budget and better signals (less interference) but it might even be capable of becoming a lower cost option, if the bonding/positioning/lapping processes aren't too expensive, and its input costs and consequences for wiring plane costs are better than the alternatives to boot!
>
”is, of course, extremely toxic, but that’s the least of the problem. It is hypergolic with every known fuel, and so rapidly hypergolic that no ignition delay has ever been measured. It is also hypergolic with such things as cloth, wood, and test engineers, not to mention asbestos, sand, and water-with which it reacts explosively." He continues, "It can be kept in some of the ordinary structural metals-steel, copper, aluminum, etc.-because of the formation of a thin film of insoluble metal fluoride which protects the bulk of the metal, just as the invisible coat of oxide on aluminum keeps it from burning up in the atmosphere. If, however, this coat is melted or scrubbed off, and has no chance to reform, the operator is confronted with the problem of coping with a metal-fluorine fire. For dealing with this situation, I have always recommended a good pair of running shoes.”All posts under the "Things I Won't Work With" series:
https://www.science.org/topic/blog-category/things-i-wont-wo...
I was on my phone, and realized I hadn’t bookmarked it.
I like all the stuff he did in that series, so the second link is great!
Here it is on YouTube[1].
[0] https://www.science.org/content/blog-post/chlorine-trifluori...
This is my favorite quote:
> And that's at room temperature. At seven hundred freaking degrees, fluorine starts to dissociate into monoatomic radicals, thereby losing its gentle and forgiving nature.
They’ve required decades of iteration to lead to the flagship products we have today. To achieve at least a fraction of that is an achievement of itself.
But yeah I am going to hold on to my NVDA for now.
Meanwhile Arc is kicking ass. It's launch was a dud, but the team has really kept pushing on making the chip run better and better & it's such a great value now. People need to reassess the preconceptions they formed at launch. https://www.digitaltrends.com/computing/intel-arc-graphics-c...
A770 has a 400mm^2 die and a 256-bit bus to 16GB of GDDR6. It only competes favorably to cards that cost less than half of what it did to manufacture.
You can say that it's a great deal for a consumer, but it is a terrible deal for Intel, and the only reason they are selling them for such a price is that they already have the stock and couldn't sell it for any higher price.
Amd's rx580 was a $280 gpu with 256bit bus too. It got down near $200 for a while. It was only 240mm^2 though. I simply don't know what chips actually can cost these days. I wouldn't be surprised to find out Intel's taking a bath here but I also would be super unshocked to hear other folks making gpus have colossal markups.
The new P's are insane.
I have an i5-1240p and it's the best chip I've ever owned.
12 cores, 25w tdp.
In any case, the i5-1240p is fantastic. I wouldn't prefer any other SOC over it given it's an Intel, an x64 chipset and an absolute animal in power, compatibility and performance (especially multi-core).
Also, their n100 chipsets are insanity for low-end, low TDP computing. I don't think there is anything comparable on the market. As I understand it, this uses all efficiency cores.
An n100 server could handle any task you could ever throw it and only pull 6watts of power.
Meanwhile, you can run Cyberpunk on the newest AMD APUs.
The m2 chip is more power efficient, but it can't compete against Intel and amd
Intel beats Apple at most specs but the margin is too small to say Apple "can't compete", especially for a company that didn't even have a desktop CPU three years ago.
In desktops (Mac Studio etc) where you can run unlimited watts, yeah Apple doesn't do as well there, but the efficiency is still amazing. And in the laptops, the actual user experience shows the cinebench numbers aren't capturing something.
Well of course a newer laptop of going to be "snappier" lmao.
"My new car is faster and more fuel efficient than my old car"
I've had quite a few MBs and they all slow down after a while, needing an overhaul/refresh in the same way that windows machines, phones etc do.
Get that red memory pressure and kernel desperately swapping pages in & out, woooo. Perhaps things are different with >16GB machines with the SSD mostly empty.
It helps that it's Unix on the desktop. If you're comparing against a Windows install then I'm sure yes it will be way snappier, if you're comparing against Linux it really shouldn't be. Linux doesn't always have powersaving down quite right etc though, ofc.
The sales pitch of OS X to powerusers imo is that it's Unix on the desktop that is well-supported by the vendor and has a good ecosystem of professionally made apps. If you want to tinker there's nothing inherently bad about Linux either, but OS X actually does just work fairly well, although it's not without flaws as well. But it's faster than Windows, less amateur than Linux, actually has a user base unlike BSD. So it sits in an interesting spot - the "willing to spend money" niche.
There are a number of downsides and unpleasant aspects to OS X too, of course. But yeah, it's inherently going to be snappier than Windows if that's your reference point, *nix generally is, that's not OSX exclusive either.
People are generally more hostile to vendor hardware-software integration today than they used to be in the past, I think. Amiga, BeOS, SGI, HP-UX, Solaris, Cray, Nonstop, zSystem, CUDA... there is a lot of the computing world that runs on proprietary hardware-software integration and always has.
It has been an interesting sea change that people see open/plays nice as the default, it's an interesting sign of how copyleft has won in the long term that proprietary is seen as greedy/suspicious in general. I've been feeling that's a significant thing for a while. People are hostile to these products when sometimes it's simply paying more for a specific thing or a niche, if you want a premium *nix laptop the M1s are very nice actually.
There's a reason it's an "ARM" processor & not an "Apple" one, even though yes, Apple did contribute a lot of their own design to their specific chip.
Unfortunately, Apple took the shortcut of gaining performance by having memory/SB/NB/kitchen sink all together on the same die, which is very...not scalable. It's a good way to be "top in class" for the class your in, but it comes with a ceiling; you can't hit the higher levels because where competitors can use the whole die for processor, Apple are stuck using only part of the die, the rest being used for memory/controllers, etc.
Absolutely stellar architecture for laptops for sure, but not so great for desktops/servers, imo.
The memory isn’t on the same die in the M-series chips.
That kind of misses where Intel pulled all kinds of illegal business tactics to have AMD excluded from manufacturers, etc.
It's not "only the past few years", it's "we're back to healthy competition" after a period of basically illegal business practices breaking the market.
Do they even remember what it is the company used to do for a living?
IMHO Intel’s R&D was humming along just fine but the company as a whole had problems pushing stuff into full production. The new CEO managed to get the company into shape enough to actually ship things again.
https://www.macrotrends.net/stocks/charts/IBM/ibm/net-income
IDK if it's enough to call it a Satya Nadella-like CEO transition, but I've been pretty impressed watching it happen.
They did one thing in their first gen that ATI/AMD and Nvidia have always completely failed to do: release 1st party open source Linux drivers that just work without any fuzz.
I see no reason to ever even look at an Nvidia or AMD card again, for my own purposes, assuming Intel keep releasing GPUs. It's laughable how bad their drivers have always been. And Nvidia's pricing is a disgrace.
Also, the way they've dragged their feet on this for decades, and still do. Doesn't inspire confidence.
On my laptop I have disabled the NVidia GPU on linux because of the drivers, and use the AMD integrated GPU. Hope Intel will prioritise open source GPU drivers in the future, if they will do that sincerely it will win goodwill from me and hopefully from the community as well.
But yeah, for fancier features like OpenCL, Vulkan, raytracing, you'd have to use amdgpu "pro" drivers which includes many proprietary parts.
Intel are definitely committed to providing open source Linux drivers for the gpus, at least based on past behaviour. They've had open source drivers for the iGPUs pretty much since the beginning(2010), IIRC.
My last two desktops actually didn't have dGPUs at all because I couldn't be bothered, and I'm not much of a gamer. But now GPUs are too important for many other things, so I'm very happy that Intel got into it. And they didn't disappoint with drivers again really. Though it did take some time to get really sorted, mostly because they had a lot of driver tech debt to sort out on all platforms. So drivers have been shifty all around, but now they're quite stable.
Since graphic cards do more than rasterization and lighting, it is very important to have a serious GPU with open source drivers, so that all the other open source projects related to ML can do more. I suppose my next GPU will be from intel (never thought I would say good things about them, after they almost killed the x86 cpus).
I think the only thing Pat Gelsinger deserves credit for when it comes to Arc is firing Raja Koduri.
Whether or not this turns out to actually be good for the company or not remains to be seen. A lot is riding on Battlemage not being a mess like Arc was.
I bought an AMD AM4 socket motherboard 3 years ago for a good price ~55$ (A320MK) and recently I upgraded the CPU (a 5600G - 12 threads at 3.9GHz with powerful integrated GPU for 100$) and the motherboard supports it. Very nice!
The replacement CEO, Pat Gelsinger, has an engineering background and looks to be fixing things properly:
https://en.wikipedia.org/wiki/Pat_Gelsinger
The Intel board looks to have recognised and addressed the financialisation problem properly for once. Pretty rare for a board.
Pity the boards of IBM, HP (etc) haven't been as capable.
Bob Swan clearly wasn't the guy that could fix all this. Pat finally got the job he always wanted (he left for VMware because he didn't get it originally), but Intel is ship that's hard to turn (floating iceberg might be a more fitting analogy).
I'm rooting for Intel; I have friends there and competition is good for us consumers. Also, Intel is a friend of open source.
Sounds like a clear Yes then.
That being said, Bob Swann was the Intels' CFO from 2016 prior to his becoming CEO. So he was still involved during the later part of Brian Krzanich's tenure.
BK was COO from 2012 and CEO from 2013, and intel was already starting to spin its wheels by that point on stuff like modems and atom and wireless and lacked a proper strategic direction. It's hard to know how much internal jank was in the architectures back then but it probably wasn't insignificant, after all Core M ties back to Pentium III and P6/Pentium Pro at least.
He certainly didn't help anything but the organization that produced BK (he started as an engineer) and put him in the boardroom wasn't going to pick Lisa Su or Jensen Huang as plan B. The organizational forces that gave us BK would have put another suit in the chair and applied the same pressures to them, the problem with historical counterfactuals is always that these forces really matter more than specific individuals being in the chair in most cases.
People forget, he was literally a process engineer by trade too, it's not like he came in as a beancounter. That was all just natural pressures of the market.
On the other hand, if you count out 5 years from when he became CEO... that's around the time the problems started with 14nm (Broadwell struggled to be born) and the point where uarch performance progression really stalled out etc. And of course 14nm was followed by 10nm and the interminable delays.
But in hindsight a lot of the delays appear to have been "termite problems", yes the process was a mess but the IP teams couldn't get their shit together either, and that's why server products have been running 2+ years behind schedule, Alder Lake has its AVX-512 disabled, Meteor Lake is not happening on desktop, and 2.5GbE is going back for its... sixth stepping? Those teams are underperforming and it has nothing to do with 10nm delays.
I realize 2015-2017 is when shit started really hitting the fan but like, unless BK walked in on day 1 as CEO and was like "alright boys we're making Broadwell shitty and giving Skylake-X the worst AVX-512 implementation known to man" it's not entirely his fault either, just the termite rot was still not structural yet. Both the fab teams and IP teams were having visible problems already not too long after he took the chair.
He's not a great CEO by any means, and he actively made things worse over his tenure but... it's kinda hard to believe that he just actively made Intel shit in 4 years as CEO all by himself. They had to have had problems already, and some things like Pentium 4 and Meltdown (which goes all the way back to P6) point to that. But moore's law was the great equalizer back then... just right the ship and catch up on the next node and you'll be fine. Nodes are an active problem right now and it requires advanced packaging that is placing more emphasis on the architecture to cater around that. Things are just a lot harder now.
Alder lake has AVX-512 disabled because 512 bit data paths on atom cores don't make sense and Microsoft couldn't execute on a IHV specific scheduling change so quickly. AVX2+ and later Windows scheduler changes will take care of this. Just like P-states, Intel now has hardware scheduling hints for the OS as well.
> Meteor Lake is not happening on desktop
Because arrow lake is tracking closely within 6 months and MTL/LNL are focused on the platform power efficiency.
> Those teams are underperforming and it has nothing to do with 10nm delays.
It very much has to do with process nodes as well, with tight coupling of process to chip area (yield, thermals) and number of transistors.
I get that they aren’t making these chips for me, but Alder lake with AVX-512 would have been so cool, it would be like having a Phi in the same package as your main cores.
I’m not sure what exactly killed the Phi, but not having to talk through PCIe might have given them a chance to keep up with the inevitable march of NVIDIA Tesla bandwidth improvements.
Second thought was "I wonder if it reduces fan noise."
I hope Nvidia adds backside power delivery to their new CuLitho chips, just so we can get as many jokes as possible out of this fab cycle.
I’ve got the Spanish speaking software engineer joke market locked up!
I thought maybe it was only the ones in the article who were saying it, but no it's also in the intel advertisement video https://www.youtube.com/watch?v=Rt-7c9Wgnds&t=73s
So just build a deeper stack of layers, rather than flipping and grinding.
But probably there is a reason.
Though I'd be curious to see what the power delivery layers look like after this change.
If anything, BPD means there are more layers that can be shown.
AMD has been doing extremely well while Intel hasn’t been able to regroup.
It looks like Intel still has a solid lead in single core perf, which is frankly the biggest factor for me for a general purpose desktop CPU. Of course, other uses have other priorities. The charts are missing one important measure, power efficiency.