Details on AMD's Quirky Chipset Solutions for AM5
angstronomics.substack.com
angstronomics.substack.com
If true and it's also true that the non-Pro Threadripper line is gone, this leaves a large gap for Intel to exploit with Alder Lake X. The Threadripper line's 60+ lanes of PCIe effectively took over the HEDT market. Intel not only couldn't compete on performance, but for storage arrays, ML workstations, other important niches, they were the only viable option.
I'm hoping the rumors of Threadripper's demise are wrong, and both Intel & AMD are able to compete in the space. That's best for consumers, not this alternating pendulum. (See: Threadripper price hikes.)
Is there some way I could edit my comment to make it clearer?
> This is for the consumer stuff and looks to have the same number of CPU direct lanes as last generation, just higher speed.
I think I disagree, as the PCIe4.0x4 slot off the chipset is now an additional step removed (& subject to greater contention). But I digress, my point is that AMD risks leaving a gap in their market coverage by doing two things:
1. There are rumors they are no longer competing in consumer-accessible high lane count CPUs/chipsets.
2. They have an opportunity with the next gen Ryzen to close the gap by (1.) offering more lanes at 4.0 speed (they could offer 40 CPU-attached lanes!) but by moving to 5.0 exclusively, they limit expansion options.
If both leaks/rumors are true, it suggests a missed opportunity.
I won't comment much on the rumour side but overall I'm not as worried about whether things are named "Threadripper" vs "Threadripper PRO" as this never set the price floor anyways E.g. a 16 core Ryzen Threadripper PRO 3950X was $350 MSRP higher than a 16 core Ryzen 9 3950X.
Whether or not they ever release anymore low price high lane count options is an interesting question but that AM5 was supposed answer this and because it didn't AM5 is a departure from the past is just too many layers of assumption, rumour, and leaks to make any useful discussion about.
Threadripper changed the definition of HEDT, but rumor is that there won't be a Zen 3/4 option for it, and those users will only have Intel as an option. That's the unusual departure.
The disappointing thing is that this chip on paper has the bandwidth - some pro users would likely be happy to get Zen 4 with the option for 0-2 PCIe 4.0x16 slots, and 2-6 PCIe 4.0x8 slots. That's the amount of bandwidth this CPU has.
Chagall/Zen 3 did drop the TRX40 chipset but again the sWRX8 class was only a small uplift from prosumer anyways so I'm not sure the loss of sTR4 is all that interesting or best compared to AM5. The question is whether they decide to continue to release Threadripper Pros at an attractive price point not lamenting why AM5 didn't absorb sTR4.
Not surprising at all given that the same vendor thought it was fine stratagem to market a midrange dedicated GPU with only 4x PCIe 4.0 lanes. They are banking heavily on the trend of turning PCIe into a serial bus of sorts.
It was always a serial bus? PCIe 1.0 was just too slow to handle everything without 16x systems. In fact, 32x slots/cards existed in the server market to make up for the missing bandwidth.
PCIe switches used to be far more common before certain things happened in the market and they became uber-expensive. I have a few NICs where, instead of using multi-port controllers, they just used PCIe switches... arguably I/O hubs have probably been the cheapest PCIe switches around for some time now...
My read of it is the second, but I'd be happy to be shown wrong on this.
Everything else not CPU direct (wired and wireless networking, SATA storage, non-primary USB ports, and 3 PCIe 4.0 addon cards) is connected via the chipset(s) which connect back via a single shared PCIe 4.0 x4 connection to the CPU. These are multiplexed but nothing here is using PCIe 5.0 bandwidth and even just 1 busy slot alone off this collection is able to consume the entire uplink bandwidth.
AM4 cpus have an x16 for GPU, an x4 for NVMe storage, and an x4 for chipset, according to the article, AM5 cpus will have an x16 for GPU, an x4 for NVMe storage, and adds an x4 for for USB4 or more NVMe storage, and then an x4 for chipset, plus whatever the USB stuff means.
The rumored chipset takes that x4 and offers two x4s, four sata/3.0 x1 ports, and 6 usb3, six usb 2 ports.
There were a bunch of different chipsets for am4, most of which didn't have more connectivity than that. If you build the x670 link two of the new chipsets, and consider the added x4 from the cpu, you still have pretty similar connectivity as the x570, but you only have 12 lanes squeezing into the x4 for chipset instead of 16. There's certainly a discussion to be had about the CPU lanes being 5.0 and the chipset lanes (including uplink to the CPU, apparently) being 4.0; but while there's not much in the way of PCIe 5.0 devices, it's mostly hypothetical. If PCIe multiplexers weren't immensely expensive, the 24 CPU lanes at PCIe 5.0 would be equal to 48 lanes of PCIe 4.0 (plus 4 more for the chipset), and pretty close to the Zen2 Threadrippers's 56 + 8. Lack of cheap multiplexers means that's not really how the cookie crumbles though.
Maybe the pricing you expect will be at a level that I am going to ignore anyways, but I think AMD may be reducing features and pci-e lanes because Intel has been doing just fine not giving away the kitchen sink in that area, at least from what I observe. Isn't intel kind of dragging their feet with any new HEDT lines?
On the contrary, compared with the previous generation, the AM5 socket has more PCIe lanes, because it has 4 additional PCIe lanes, to attach directly to the CPU a Thunderbolt/USB4 controller, for maximum performance.
The changes are strictly in the chipset, which will now be able to provide more PCIe lanes than before, on more expensive motherboards with 2 southbridge chips, but with the price that the extra lanes will pass through an additional PCIe switch, so they will have a greater latency and their throughput can be diminished by congestion, when all the peripherals are active simultaneously.
Nevertheless, with 64 Gb/s links between chips (4 x PCIe 4.0), few peripherals will be fast enough to saturate the links and cause congestion, i.e. typically only the extra SSDs or extra GPUs, besides the primary GPU and the primary SSD, which are attached directly to the CPU.
So the extra SSDs and the extra GPUs should be preferentially attached to the first southbridge chip, not to the second. This is the change about which the users of the new AM5 motherboards must be aware.
While the daisy chain is interesting, it doesn't sound like it gets you much at the end of the day and will double power usage (which was a real sore spot with x570 vs the asmedia chipsets) The dual chipset sort of seems like it's just a luxury item without a purpose in most cases. Maybe we'll see some interesting designs with server oriented boards but doubling the power usage doesn't seem worth what it will get you to me.
I'm not quite sure the dual linked chipset option for the high end really gets anyone anything. I mean sure, double all your ports... where half now have 2x the latency penalty to the CPU and all in all they are sharing less bandwidth than your primary storage slot has alone.
Are any of the typical uses for those IO lanes latency-sensitive enough for that to matter at all? Consumer-grade networking, SATA storage, and most USB use cases all involve latency high enough that one more PCIe switch wouldn't be noticed.
Typical USB poll rates are 10-100 milliseconds. AMD made a perfectly sensible choice.
But nobody cares about USB. A lot of applications do 10000 reads from your SSD in series (qd1) and that’s where latency matters. I agree that it should be on the order of 1us. And since most people only have one SSD, chipset latency is not that important.
But who knows, maybe "I have a great gaming PC, it's got 25 USB ports!" (yes, that's the actual number) is more marketable than actually tuning for performance.
Definitely not. Consumer Optane is dead, so the only devices that will get used in those slots have inherent latencies that are multiple orders of magnitude higher than those typical for a PCIe switch. The extra switch latency gets entirely lost in the noise, which I've observed on multiple occasions while reviewing "NVMe RAID" products.
https://cdn.thefpsreview.com/wp-content/uploads/2021/09/crys...
https://cdn.thefpsreview.com/wp-content/uploads/2021/09/crys...
https://cdn.thefpsreview.com/wp-content/uploads/2021/09/crys...
Definitely not expecting end of the world numbers from it but at the same time I doubt many in the high end space are going to look at what that second chipset gives them and say "it's worth adding another PCIe switch in-between my addons for".
Of course you can just use the second x8 worth of bandwidth for drives but I'm not sure that sells having a chained chipset over just adding what you actually want to the first which would now have more open lanes anyways.
https://www.tomshardware.com/news/amd-x670-motherboard-diagr...
If you could have your CPU placed symmetrically in the middle of the board with slots, ports etc both above and below so they don't get too long traces then maybe? But that would go against the ATX spec.
I also wonder how often communication happens from one device direct to another without touching CPU? Is that a thing? DMA has been a thing for many years but with the memory controller on the CPU communications would still have to get there.
X670E: "Everywhere" according to the talk, which I interpret as: - 16 lanes of pcie 5 to the main pcie slots - 4 lanes of pcie 5 to the primary nvme slot (i would not be surprised if some boards will expose this as a pcie x 16 slot (with 4 lanes)) though. - 4 lanes of pcie 5 to the chipset (speculative)
For the regular X670: - 16+4 pcie5 lanes to "GPU" and "nvme" slots, as for the X670, perhaps only 1 nvme slot, perhaps with an additional nvme x8 slot when running 8/8/4 instead of 16/0/4. - "only" nvme 4 to the chipset
B570: - Only the "nvme" slot will have version 5
If I'm right, the Extreme card will offer twice the performance over the chipset, compared to AM4, which could allow it to fill some of the use cases currently covered by the non-pro threadrippers. If I'm wrong, and even the extreme X670E chipset will not be a good choice for those who depend on a lot of IO, compared to threadripper or Intel.
Hopefully, I'm right, and in that case, I'm not sure if we need an intermediate step between the 7950x and lower end threadripper pro setups, at least not for connectivity and I/O. And those who actually need more compute than the 7950x will over will probably not care that much about the price premium of threadripper pro vs regular threadripper.
I'd be fine with PCI-E 4 across: x16 (gpu) + x16 (gpu/accessory) + x4 (nvme) + x4 (nvme) + x4 (their slow IO chipset).
PCI-E 5 is 2x the bandwidth, so maybe some higher end boards might offer more choices for splitting those lanes up at slower speeds that work well with older addin cards.
A (1.25GB/sec) 10GBit Ethernet card is on the radar for the lifetime of these systems. A 4.0 x1 link is sufficient at ~ 1.97GB/sec.
I'm worried too many boards will ship with two GPU slots (5.0? / 4.0 x8) and at most 2x NVME slots, and load _everything_ else on those x4 slots for the board chipsets, including accessory slots.
If you want to load up a bunch of low-speed devices (and 10Gbit/s is low-speed now), the chipset is the right place to do it. Consumer systems really are not going to be bottlenecked by lots of devices sharing one x4 uplink to the CPU.
The block diagrams show (for useful devices):
CPU / APU:
* RAM ???
* 5.0 x8 + 5.0 x8 GPU(s?)
* 5.0 x4 NVMe
* 4.0 x4 2x USB4 #1
* 4.0 x4 for PROM21
* DP / HDMI #1
* 2x USB 3.2 10Gbit
* 3x USB 2.0 (why?)
* SPI / GPIO HDAudio #1
#1 expected ASM4242 mux with 2x DP for APUs -- It'd be nice if these pins could export additional PCIe lanes for non-APU systems.That 4.0 x 4 set of lanes is expected to service up to...
* 4.0 x4 (bridged daisy)
* 4.0 x4 NVMe
* 4x SATA 6Gbit/sec
* USB 3.2 20Gbit
* 4x USB 3.2 10Gbit
* 4x USB 2.0
+ * 4.0 x4 (daisy to cards)
* 4.0 x4 NVMe
* 3.0 x1 2.5Gbit Ether
* 3.0 x1 + 2.0 USB WiFi
* 2x SATA 6Gbit
* USB 3.2 20Gbit
* 4x USB 3.2 10Gbit
* 4x USB 2.0
__ideally__ they'd have done something more like x4 PCIe 5.0 for the secondary NVMe drives and downstream system ports to share, along with an x2 PCIe 5.0 link utilized for the other existing ports on the two chips.In the end, the devices chipset AMD has sourced from 3rd parties is good as a general tool for manufacturers... My issue is that I'd _really_ like their high end chips to support more PCIe 5.0 x4 lanes, possibly used in aggregations.
Imagine if they instead supported 5.0 x16 (or x8+x8) AND 5.0 x16 (2x8 || x8+x4+x4 || 4x4). That'd allow for either a second full x16 slot for future mass IO devices (be it a GPU or NVMe riser card) or the full sized ATX boards with a good number of x4 slots.
Maybe that is what a lower core count, higher mhz, thread-ripper socket was really for.
It is. Historically the HEDT sockets have often overlapped with the consumer socket in terms of core count - this was true of X58, X79, and sTR4, and X99 was so cheap that de facto it did overlap anyway (5820K basically cost the same as a 4790K, and motherboard costs were in-line with what we saw from X570 boards until the B550 line settled prices down a bit).
That’s fine because HEDT is not about core count, it’s about memory and PCIe lanes. The current offerings leave a void for "I want a big platform but I don't need >24 cores and I'm still somewhat price-sensitive", the classic "workstation/prosumer" tier that used to be serviced by things like the 5820K/3930K/1900X/1920X.
Potentially you could get to a similar place with a bunch of PCIe 5.0 slots attached to PCIe switch chips - this style of board used to be called “supercarrier” by one brand. Unfortunately it pretty much died out in the wake of SLI and crossfire becoming niche and then extinct. And the current crop of Intel and AMD boards only offer PCIe 5 on the first slot anyway so that isn’t quite as possible as you’d think at first glance.
It’s really a shame the way AMD hollowed out the HEDT segment and cranked prices. A 3960X is four 3600s on a HEDT package with a single bigger IO die instead of four little ones, it’s a very cheap chip to produce, it should really go for more in the $700-800 price range than $1600+.
(And the HEDT boards are also quite expensive for what they are - the ROMED8-2T gets you 7x slots of PCIe 4.0x16 full-capacity, with power delivery for 280W TDP CPUs, dual 10gbe, and BMC, for $600. Look at what a $1000 sTRX40 board buys you and just laugh, "gamer" boards are ripping you off.)
Again, the precedent is the 5820K and the TR1900 series where these savings were passed on to the consumer - it is historically abnormal for HEDT to be such a huge reach compared to desktop chips, but AMD isn’t interested in pursuing low-end (actually they aren’t even interested in releasing Zen3 HEDT chips at all outside WRX80) and Intel has abandoned the segment entirely for now. Maybe Alder Lake-X will change the situation and force AMD to pay a little more attention, just as it has forced some of the ridiculous 5000 series price increases to be backed down.
Right now it is actually worth a strong look at Epyc server boards like ROMED8-2T and chips like the 7402P because if you don’t need the absolute clock rate of Threadripper the Epyc chips are often cheaper per-core while offering a better PCIe and memory capability. That’s completely opposite from how HEDT has always worked but AMD is pushing hard in the server segment and sandbagging in the HEDT segment and that flips the math in a lot of homelab or workstation situations.
Keynote slides that just came out show RDNA2 in the Zen4 I/O die, so it looks like there won't be non-APU systems. I think you'd have trouble using pins for PCIe sometimes, and DisplayPorts other times, depending on the CPU you install, would make things more confusing, IMHO.
Of course, the chipset itself has nothing to do with what connectivity is provided to the PEG slots since those run straight to the CPU - this is market segmentation in action, the CPU simply won't turn on those feature-bits if you don't pay for the premium chipset.
Also, as noted, on AMD the chipset has nothing to do with anything anyway. It is just an IO expander, it doesn't boot the CPU or do anything like that, and it is entirely uninvolved, out of the loop entirely, when the CPU is talking to things that are attached to PEG direct lanes.
Won’t the timing of each chipset on each board need to be painstakingly individually configured to avoid latency from a “default” profile used in all chips (which inherently vary between every batch)? Yes, yes they would.
Unless you had an automated solution. And if you have an automated way you could optimize CPU and DDR timing instead of using “buffered”/ “safe” latency settings to accommodate any manufacturing variance.
Well turns out AMD has a method for that. And given the necessity for a tech like this to make daisy chained chipsets work, it would seem this isn’t an idle patent. AM5 systems are basically going to get a 10-20% performance bump due to that optimization. Which is wild.
https://www.tomshardware.com/news/amd-patents-automatic-memo...
No, because PCIe works completely differently from RAM. PCIe is a packet-based protocol that's very latency-tolerant. (Multi-lane PCIe links may require deskew but that's a standard feature that has existed all along.) I think it was Marcan who tunneled PCIe over RS-232 and the chips didn't even notice.
This is true. However with the MCH off-chip and worst case inter core latency comparable a DRAM refresh cycle, AMD could in theory move the MCH away from the socket and see no major performance penalty.
Not to mention the Zen 2 IO die is just a cut-down version of X570, or maybe it is the other way around heh?
No, the chipset is in the Ryzen CPU. What they mean is a Southbridge used by board manufacturers for market segmentation purposes.
>AMD’s Ryzen line of client Desktop processors don’t even need a ‘chipset‘
Amazing, an article stating the truth for once!
>Despite this, nearly all Desktop motherboards still contain a chipset, but in its modern iteration serve as I/O expansion hubs
and back to muddying the water. No, "chipsets" are used for market segmentation, and AMD is complicit with gems like this:
https://www.itworldcanada.com/article/amd-zen-3-processors-w...
https://www.extremetech.com/computing/320548-amd-will-suppor...
https://www.anandtech.com/show/14477/amd-confirms-pcie-4-not...
https://www.eteknix.com/some-asus-x470-and-b450-motherboards...
not to mention overclocking lockouts
all this bullshit depending on what ASMedia IO dongle connects over PCIE bus on the motherboards.
>dual-source these chipsets
and proceeds to explains how there will be none of that with exclusive ASMedia once again :)
>Low-end, Mid-range, High-end
ah yes, back to artificial segmentation based on limited BW 4x PCIE switch while CPUs provide plenty of dedicated PCIE lanes.
>“X670E“ branded motherboards will require the primary PCIe and M.2 slots to support PCIe 5.0 linkrate. The chipset itself is identical to X670.
and now we are at making up totally fake name for a non existent product X670E to upmarket PCIE 5.0, sweet!
>designing only a single piece of silicon to span across multiple market segments, it is much more cost-effective to design for the mass market middle-end solution and double up for the high-end rather than designing a larger, more expensive die that fits the requirements of the top end
spilling truth by accident once again. Yes, AMD is selling us the same cheap solution under different names for different prices, and we should be thrilled!