Will Intel's AXG division survive Pat Gelsinger’s axe?
jonpeddie.com
jonpeddie.com
Their issue at the moment isn't strategy. It's execution. Axing their GPU division would only hurt their current plan, and do nothing to fix the the systematic problem that they're missing deadline's and shipping incomplete products. From the outside looking in, it seems like there's some fat that needs trimming and people aren't pulling their weight. If they can scale back to efficient team and org sizes, cut the side projects, and focus on excellent software and hardware validation, I can see them pulling this off and Pat being lauded as a hero.
There is such a long term history of failure here that somebody has to make a very strong case that the next time is going to be different and I've never seen anyone at Intel try that or even recognize that history of failure.
Nowadays only Chinese seem to be able to give it away to grow market share. $1 Espressif is a good example, Govin $7 GW1N-1 fpga devboards. Raspberry <$1 RP2040 is one western exception I could come up with.
I was also going to mention some dev boards NVIDIA had come out in the last few years that were affordable (I think) but they are all out of stock now and the ones you can get are $2000+ now.
It also claims to do this across radically different architectures like FPGA and all I can say to that is "I find that very hard to believe"
One common instance is, blender's Cycles renderer. Every time there is a new NVIDIA GPU. It needs to be recompiled to support it. Sometimes that also requires a new CUDA version to be able to do it. CUDA versions over the years have deprecated different operations and what not.
Although for completeness I'll note that Intel's GPU architecture is documented: https://01.org/linuxgraphics/documentation/hardware-specific...
The fact that a similar API can be used for training on servers, inference from laptops to phones, is an appealing proposition
Best part: most devices have decent vulkan drivers. Unlike openCL.
I could see Apple and AMD, working with TSMCs latest node, stepping up to the challenge.
Meh, not really. Google has some of the best engineers in the world yet they fail at nearly everything that isn't related to search, android, ads and e-mail.
Even Jensen Huang said that it's more about vision and not all about execution. He said in the early days of Nvidia all of their competitors at the time had engineers good enough to execute, yet only they had the winning vision that enabled them to make and sell exactly what the market wanted, nothing more, nothing less.
That and their culture of "move fast, fail fast" means they pull the rug just as fast as they lay it out.
And YouTube.
No wonder they are 10X as valuable as Intel
It was Google engineering that allowed YT to scale.
Google video engineering wasn't up to snuff and management decided to move fast and just acquire YouTube.
So hiring the best 1337-coders in the world didn't automatically give them the best product? Shocking.
When YouTube joined Google, their engineers were shocked to find that Google engineers were writing 1000s of lines of server side C++ code, that could be accomplished in 100s of lines of python code. Which explained why YouTube was able to move a lot faster and pump out features, while Google video was struggling to keep up.
It was not the leetcode engineers, but Dean and Ghemawat insisting on C++ only on the server. Its still true today. Go might be making inroads now.
> Meh, not really. Google has some of the best engineers in the world yet they fail at nearly everything that isn't related to search, android, ads and e-mail.
Seems to me that Google didn't fail to execute in other things they tried. The products worked fine, but they didn't have a market.
That's not failure of execution, it's failure of strategy.
I've noticed it's very hard for a lot of technical people to give credit to executives, marketing, finance, or anyone else when it comes to the success of a technical product, but very easy for them to assign blame to those groups. Whereas those latter groups often seem to be the first to credit engineers with successful products, and willing to share blame for failures.
Maybe it's because I'm in the technical group so I hear insider gossip and rantings, and the other groups project an overly generous facade, but unfortunately sometimes it doesn't feel like it. Ask a sample of nerds about failed projects near to their hearts. DEC, Sun, Boeing, whatever Google chat app they liked, the failed company or project they worked on, etc. 9 times out of 10 you'll hear rantings about greedy management, incompetent finance, the idiots in marketing, etc. who wantonly desecrated the Mona Lisas and Sistine Chapels of Engineering.
Many engineers are very good at taking a problem given to them by their company or one they've dreamed up and optimizing the hell out of it. Very few are capable of identifying problems that will be valued by others, and coming up with approaches to solving them in ways that are cost competitive and marketable. Very few people at all can do that well because it requires a measure of creativity and multi disciplinary vision, but at least executives are supposed to be thinking about these things so they have a chance.
They have competitive NICs, although they don't seem to be maintaining the lead there they once had.
They bought competitive network switches. These have largely languished, in part because they sat on the IP and then targeted it at weird niches.
They bought Altera. I feel like it had lost some momentum vs. Xilinx, but with AMD acquiring the latter, it's probably going to end up a wash.
The AI chips are kinda too early to tell, but at least they're playing the game.
Overall, I think they have squandered the massive advantage they had in CPUs for the last 3 decades.
The low end AI chips are a mess. Myriad-X can be used only through openvino, and they've been closing details about the internals... Keembay is... Years late?
Is there anything coming out of Intel these days?
And what happened to nervana systems, became plaidml then disappeared after bought by Intel? Maxas was really great and now, crickets.
Even profiling tools, which they used to be on top of, don't seem to work well on Linux w/ the TigerLake gpu. It's so painful to debug and program, they might as well have not put it in...
That's a reflection of their company culture. They're a bit stiff.
Yeah they do, Intel has the FPGA division they bought from Altera. That's a huge business on its own.
And my point still stands: having great engineers is not enough for great execution. You need great leadership with a vision a-la Steve Jobs or Jensen Huang.
And the reality is that yeah, with their comp for engineers so abysmally bad why would anyone really go there? Especially when it's not like they're getting great WLB.
But yes, that probably does not make it a psychologically safe place to work...
I mean, "make the fastest CPUs and GPUs and charge a premium" would be a great strategy if they could deliver. But in a world where they're struggling to keep up on the CPU side, pouring resources into GPUs could lose them both markets.
I can't remember the last time I sincerely used an integrated GPU, Intel or AMD, since they're too weak for my purposes. I only ever use them as a Lowest Common Denominator failsafe when troubleshooting.
And for use cases (not necessarily mine) where low-end GPUs make sense, it's not like Nvidia and AMD don't sell bottom of the barrel GPUs that you (or OEMs) can buy for a Franklin each or something.
Ay, there's the rub!
We are in 2022 I still dont understand why Raja is popular. One of the reason why I have been extremely sceptical of Intel's GPU since the very beginning. To the point I got a lot of bashing on Anandtech and HN.
And I have been mentioning drivers as the major concern since 2016. Citing PowerVR Kyro on Desktop as an example. Even pointing that out on Twitter. With one of the Intel Engineers on the GPU team replied something as "GPU Drivers is a solved problem".
I do love to be wrong. But it is increasingly looking like another item to be added to my book of prediction that came true.
and he's done the exact same thing.
That's how failing upwards works in this racket. As long as you have a great looking resume at a few giants in the industry with some fancy titles to boot, you're set for life regardless of how incompetent you are.
I dont think Intel should axe their GPU, but considering Pat Gelsinger has zero BS tolerance, I would not be suspired if someone replace Raja if he doesn't deliver within the next 12 months or so.
> He became the director of advanced technology development at ATI Technologies in 2001.[3] Following Advanced Micro Devices's 2006 acquisition of ATI, he served as chief technology officer for graphics at AMD until 2009. At S3 and ATI he made key contributions to several generations of GPU architectures that evolved from DirectX Ver 3 till Ver 11.[4] He then went to Apple Inc., where he worked with graphics hardware, which allowed Apple to transition to high-resolution Retina displays for its Mac computers.[5]
So he has a history of launching some really good products but I'd say it's been at least a decade since he's been involved in anything industry leading.
There needs to be accountability for these failures of execution.
You know, except for a competitive desktop GPU. I'm actually impressed that it didn't take much longer and much more money to catch up with AMD and NVIDIA, given that those two were in business when 3dfx was still around.
Sure, their iGPU offerings were never competitive for gaming or complex tasks, but given it came for "free" with your CPU, it was good enough for most businesses and consumers and was a also a major boon during the GPU shortage where gamers who build systems with AMD chips were left unable to use their PC while those who went Intel could at least use their PC for some productivity and entertainment until they could buy a dGPU.
So it's not like they had to start absolutely from scratch here. In fact, Intel's latest integrated GPU architecture, Xe, was so good, it was beating the integrated Vega graphics AMD was shipping till the 6xxx series with RDNA2 in 2022, while also killing the demand for Nvidia's low end dGPUs for desktops (GT 1050) and mobile (MX350). Xe was also the first GPU on the market with AV1 decode support.
So given this, Intel is definitely not a failure in the GPU space, they're definitely doing some things right but they just can't box in the ring with "Ali" yet. Anyone thinking they can leapfrog Radeon and Nvidia at their first attempt would be foolish. Intel should take on the losses on the GPU division for a few more years and push through.
No, and actually in some respects that's not a good thing either. Their existing iGPU driver was designed with the assumption of GPU and CPU memory being pretty much fungible, and with the CPU being pretty "close" in terms of latency, just across the ringbus. It wasn't even PCIe attached, like how AMD does it, it was directly on the ringbus like another core.
Now you need to take that legacy codebase and refactor it to have a conception of where data lives and how computation needs to proceed in order to feed the GPU with the minimum number of trips across the bus. Is that easier than writing a clean driver from scratch, and pulling in specific bits that you need? ....
One of their recent bugs in raytracing was literally due to one line of code in an allocator that was missing a flag to allocate the space in GPU memory instead of CPU, a one-line change produced a 100x speedup in the raytracing performance.
https://www.phoronix.com/news/Intel-Vulkan-RT-100x-Improve
It is most likely much easier to do what AMD did and go from discrete to integrated than the other way around... again, they don't have a tightly-coupled design like Intel did, their iGPU is literally just a pcie client that happens to be on the same die.
(also, AMD paid the penalty like 15 years ago... there were terascale based APUs, and the GCN driver was developed as a dGPU/iGPU hybrid architecture from day 1, they never had to backport GCN itself from dGPU, that was all done in the terascale days.)
Hah, I remember the time I spent a week dodging the software renderer to figure out why my shader wasn't working on an intel iGPU -- turns out that someone at intel decided to implement "float" with an 8 bit float. Not 8 byte, 8 bit.
"Sure, we support floating point, what's the problem?"
This comment baffles me, both AMD and Intel have CPUs with onboard graphics and those without. You even noted the integrated graphics a sentence later.
If anything, this is more evidence that AMD is following the Intel playbook by having that integrated CPU/ GPU architecture plan.
Why does it baffle you? AMD has only been selling desktop chips with integrated GPUs only for a few years now (they called them APUs), and their APUs were not that stellar at either the GPU or CPU part due to compromises on both parts.
Most of the successful Ryzen chips AMD was selling for the desktop were exclusively without integrated GPUs, to save die space and cost, which hurt PC builders during the GPU scalpocalipse, while on the other hand, Intel's almost entire CPU product range for desktops had integrated GPUs for over 10 years now, enabling PC builders to at least use their PCs until a dGPU could be available.
Sure, Intel sold some CPUs without iGPUs but those were very few SKUs in comparison. Similarly, but in reverse, AMD also sold some Ryzen CPUs with iGPUs(APUs), but those were very few SKUs as their CPUs were weaker than the non-iGPU SKUs, and their outdated Vega iGPUs were pretty weak even compared to Intel's Xe.
So that's the major difference between Intel and AMD that was a game changer for many: Intel shipped most of its chips with iGPUs for over a decade while AMD did not, meaning you always needed to buy a dGPU, and if you couldn't, like in the past ~2 years, well ... good luck, your new tower PC is now an expensive door stop.
Still baffled?
https://en.m.wikipedia.org/wiki/Intel_Graphics_Technology (introduced 2010)
Note I'm not an AMD fanboy, but I've 3D in my lifetime was popularized by 3DFX, so I remember the entire saga.
None of these groups are remotely as close to Intel's core (pun intended) business, as this one. It is certainly true that this division needs to produce better results, but that's true of the company as well. Chopping this one, unless there is some plan for a replacement strategy in the GPU space, would be a bad sign, as it would suggest a company circling the drain/milking the existing winners, unable to make any new winners.
All three AMD, nvidia and Apple are unifying general purpose compute with graphics. That is the direction the world is going. Unless intel had a new arch trick up their sleeves they will be soon made redundant
Same reason NVIDIA wanted to buy ARM. Intel and NVIDIA are in trouble unless they can make that leap.
Long-term it's the same reason AMD bought ATI too, that vision just took a long time to come to fruition. Remember, they "acquired" their way to success as well, RTG wasn't something that AMD indigeneously developed themselves either... just like AMD bought Xilinx and Intel bought Altera.
Intel is way too quick to give up. Imagine if they had continued to make ARM CPUs. Apple may have never pursued making their own chips. Intel CPU's + modems could be competing with Qualcomm for every mobile device sold today.
This group is supposedly 6 years old. But reciprocally, the other players have been pouring money in over decades. GPUs are fantastically complicated systems. Getting started here is enormously challenging, with vast demands. Just shipping is a huge accomplishment. Time to grow into it & adjust is necessary. It's such a huge challenge, and I really hope AXG is given the time, resources, iterations, & access to fabs it'll take to get up to speed.
Larrabe was shown at GDCE 2009 as if going to render the competition useless, then faded away.
Their GPU debugger marketing sessions used to be focused on how to optimise games for integrated GPUs.
I really don't get how they keep missing the mark versus AMD and NVidia in both GPU design and developer tooling.
Except mobile ARM chips and mobile LTE modems, both of which Intel sold off, and those are some of the most desirable things to make right now. Just ask Quallcomm.
The very second someone else but Apple brings a competitive ARM desktop CPU to the market, it's game over for Intel. x86_64 literally cannot compete with modern ARM designs simply because of how much utter garbage from about thirty years worth of history it has accumulated and absolutely needs to support in the future because even the boot process still requires all that crap, whereas ARM was never shy about cutting out stuff and breaking backwards compatibility to stay performant.
The only luck that Intel has at the moment is that Samsung and Qualcomm are dumpster fires - Samsung has enough problems getting a phone to run at a halfway decent performance with their Exynos line and Qualcomm managed to completely botch their exclusive deal with Microsoft [1] (hardly surprising to anyone who has ever had the misfortune to have to work with their crap). A small startup that is not bound by ages of legacy and corporate red tape should be able to complete such a project - Annapurna Labs have proven it's possible to break into the server ARM CPU market well enough to get acquired by Amazon.
[1] https://www.xda-developers.com/qualcomm-exclusivity-deal-mic...
Conventional wisdom in the mid 90s was powerpc (RISC) would eventually be better the x86, but it never happened. They worked around the issues. And Microsoft eventually made an OS that wasn't a crash fest (I'm looking at you windows ME)
Also no one can afford to be on TSMCs best node when Apple buys all the production. Apple's been exclusive on the best node for at least a couple years now. Even AMD isn't using TSMCs best node yet.
Yeah, but that was (at least on the Mac) not a technical requirement, they just didn't want to carry around the kernel-side support any more. IIRC it didn't take long until WINE/Crossover figured out a workaround to run old 32-bit Windows apps on modern Macs.
> Also no one can afford to be on TSMCs best node when Apple buys all the production. Apple's been exclusive on the best node for at least a couple years now. Even AMD isn't using TSMCs best node yet.
Samsung has their own competitive fab process, but they still have yield issues [1]. It's not like TSMC has a monopoly by default.
[1] https://www.gsmarena.com/samsung_claims_that_yields_from_its...
No. All it needs is
- Microsoft and Qualcomm breaking their unholy and IMHO questionably legal alliance
- an ARM CPU vendor willing to do the same as Apple did and add support for accelerating translation of x86 code (IIRC, memory access models/barriers are done differently between x86 and ARM, and Apple simply extended their cores to be able to use the same memory access/barrier model as x86 on translated-x86 threads)
- an ARM CPU vendor willing to implement basic functionality like PCIe actually according to spec - even the Raspberry Pi which is the closest you can get to a mass market general-purpose ARM computer has that broken [1]
- someone (tm) willing to define a common standard of bootup sequence/standard feature set. Might be possible that UEFI fills the role; the current ARM bootloaders are a hot mess compared to the old and tried BIOS/boot sector x86 approach, and most (!) ARM CPUs/BSPs aren't exactly built with "the hardware attached to the chips may change at will" in mind.
Rosetta isn't patented to my knowledge, absolutely nothing is stopping Microsoft from doing the same as part of Windows.
[1] https://www.hackster.io/news/jeff-geerling-shows-off-an-amd-...
This reminds me of Iron Man 1... "Tony Stark was able to build this in a cave! With a box of scraps! - Well, I'm sorry. I'm not Tony Stark."
Apple has managed to pull it off so well that the M1 blasted an i9 to pieces [1]. The M1 is just so damn well more performant than an Intel i9 that the 20% performance loss compared to native code didn't matter.
[1] https://www.macrumors.com/2020/11/15/m1-chip-emulating-x86-b...
The use case for the vast majority of laptops include I/O- and memory-bound applications. Very few CPU-bound applications are run on consumer laptops, or even corporate laptops, for the most part. CPU-bound applications should be getting run on ARM or GPU clusters in the cloud.
The use case for an M1 in laptops is the power benchmarks vs. an i9.
Where the M1 just blows anything desktop-Intel out of the water, partially because they integrate a lot of stuff directly on the SoC, partially because they place stuff like RAM or persistent storage extremely close to the SoC whereas on desktop-Intel RAM, storage and peripheral controllers are all dedicated chips.
The downside is obviously that you can't get more than 16GB RAM with an M1 and 24GB RAM with the new M2's and you cannot upgrade either memory at all without a high-risk soldering job [1]... but given that Apple has the persistent storage so closely attached to the SoC to swap around, it doesn't matter all that much.
[1] https://www.macrumors.com/2021/04/06/m1-mac-ram-and-ssd-upgr...
Wouldn't bet on that one
... Oh yeah, and there are the junkware features like SGX and TSX and also the long legacy of pernicious segmentation that means Intel is always playing with a hand tied behind its back, for instance, the new laptop chips that should support AVX512 but don't because they just had to add additional low performance cores.
If you have all the cores running hard the power consumption goes up a lot but if it is just one core it won't go up too much. If worse come to worse you can throttle the clock.
In general it's a big problem with SIMD instructions that they aren't compatible across generations of microprocessors. It's not a problem for a company like Facebook that buys 20,000 of the same server but normal firms avoid using SIMD entirely or they use SIMD that is many years out of date. You see strange things like Safari not supporting WebP images on a 2013 Mac while Firefox supports them just fine because Apple wants to use SIMD acceleration and they'd be happier if you replaced you 2013 Mac with a new one.
I worked on a semantic search engine that used an autoencoder neural network that was made just before GPU neural networks hit it big and we wrote the core of our implementation in assembly language using one particular version of AVX. We had to do all the derivatives by hand and code them up in assembly language.
By the time the product shipped we bought new servers that supported a new version of AVX that might have run twice as fast but we had no intention of rewriting that code and testing it.
Most organizations don't want to go through the hassle of keeping up with the latest SIMD flavor of the month so a lot of performance is just left on the table. Intel is happy because their marketing materials can tell you how awesome the processor is but people in real life don't experience that performance.
I'm glad to hear some newer AVX512 implementations are better. I haven't used an Intel one for years, but I have used the current-gen Ryzen version. Unfortunately it's still suffering the same problems-last time I stress-tested it my CPU hit 100C and some absurd power number before I was too scared to continue. Granted, that was with Prime95, which I believe is close to peak utilization.
OEMs/ODMs/System Integrators get awards for shipping intel products, but instead of pure cash like in 2000 its hardware and rebates. Until very recently intel was giving out SSDs for free, probably switched to something else since they dont make those anymore.
It seemed to me scaling the existing architecture to have more processing and bandwidth should have yielded a very competitive GPU while reusing their existing talent pool.
Instead we end up with a very buggy, very specialized (needs resizable bar?, DX12 works well but not other runtimes?) that aren't required today for Intel graphics.
This phrase does it, this guy has no clue whatsoever. Baffling.
In my opinion, when they wanted to get back into graphics, they should have brought back Xeon Phi, maybe doubled the vector width (and added some special units), and hired some engineers from HFT firms to figure out how to make it pretend to be a fast GPU.
Really struggling to see this leading to a successful outcome - even if they produce a reasonable product it’s likely to be third placed which is not a comfortable place to be.
Who are the six startups? It mentions four are in China, and two in the US.
Err... what? Who's got the $billions to compete with NVIDIA and AMD?
If Intel couldn't do it with $3.5B invested and existing silicon design experience and a bunch of fabs... who can!?
Intel needs to buy talent, make shit loads of mistakes, try as hard as they can to squeeze as much driver optimization as they can in reduce the driver gap as much as possible.
https://www.mobygames.com/images/covers/l/51358-pod-windows-...
https://www.hardware.fr/articles/95-5/jeux-optimises.html
https://news.ycombinator.com/item?id=28237085 "I can tell you that Intel gave companies $1 million for "Optimized" games for marketing such."
Intel has to slog through this. Forget about CUDA support - Apple is going to kill that monopoly for them.