Unfortunately the BoM on these things is probably super high. Like abdornally high even for a datacenter GPU.
AMD is coming out with a "strix halo" APU somewhat appropriate for compute.
AMD is coming out with a "strix halo" APU somewhat appropriate for compute.
You would save money on improved yields of chiplets and on using cheaper nodes where appropriate. I imagine that would help offset the increased packaging costs.
However, they are moving to compete in a market where the profit margins are so obscene that a small increase in the cost of materials really wouldn't be an important factor.
> Nvidia Makes Nearly 1,000% Profit on H100 GPUs: Report
https://www.tomshardware.com/news/nvidia-makes-1000-profit-o...
Five years ago when AMD was recovering from near bankruptcy, it was battling Intel (100K+engineers) in CPUs and Nvidia (20K+ engineers) in GPUs
It was doing that with just 10K engineers and a fraction of the R&D budget of the giants.
Things have changed now. AMD has more than doubled their headcount and R&D budgets. Within the last year the company has pivoted to AI as their main focus.
It seems unfair to criticize AMD or Intel for placing losing bets on other market segments when things could have just as easily turned out differently.
OpenCL sucked for other reasons too, but it likely wouldn't have succeeded even if it didn't suck.
Other than locking out the technologies they see threatening, they’re completely a fair company, if you want to believe in that.
There are some existing APU systems - I use low wattage ones as thin clients. Currently thinking it should be possible to write code that runs slowly on a cheap APU and dramatically faster on a MI300A system. Debug locally, batch compute on AWS (or wherever ends up hosting these things).
Also know as cost of the chip.
As a shorthand for expected retail cost, that is terribly misapplied. Or even for internal cost.
The chip would be one line item on the BOM for the entire thing you plan on shipping (but not packaged yet). Even in the case you are "just" selling a chip, the BOM is likely more complicated,and in this context primarily the manufacturing side cares about that. The COGS (cost of goods sold) is something the company as a whole will care more about - this is what it actually costs you to get it out the door. You will hear "BOM cost" referring to the elemental cost of one item on the BOM, but that's not the BOM itself.
None of these are related to the retail (or wholesale) cost in a simple way, either than forming a floors on long term sustainable price.
The GGG-whatever post is using this sloppily to suggest that the chips are going to be very expensive to produce, therefore the product is going to be expensive.
You'll also see BOM in a materials and labor type invoice, (like when you get your car serviced) but that's not relevant here.
What I really meant was total production cost + reasonable amortization cost for the development/tape out, which is of course is huge even if this chip was mass produced.
The point kinda stands though, this thing is collectively way too hard to fab + assemble to sell to consumers at any reasonable cost, especially on top of the massive R&D AMD, TSMC and everyone along the huge chain put into it.
Its not like a 4090 or Apple Silicon where the production is reasonably cheap, but margins are super high because they can be super high.