AMD is determined to gets its rightful datacenter share
nextplatform.com
nextplatform.com
AMD has a profiler, but it is nowhere near as capable as Vtune.
AMD has ways to do some things that Intel's PCM tools do (like monitor memory bandwidth), but they are exceedingly awkward (eg, only option is producing a CSV, no live output). And there are lots of things which are just missing (like support for monitoring NUMA fabric bandwidth, PCIe bandwidth, power, etc). I gave a talk at AMD in Austin last fall where I beat them up about some of these things.
Oh, and I'm up to over 260Gb/s of 100% TLS traffic from an AMD Rome :)
That said, AMD (and Intel) have reinvented themselves several times with pretty big cultural shifts so I'm hopeful they get someone like Jim Keller with the authority to shake things up.
Who do you think designed the Zen architecture? He as since left AMD, went to Tesla, and is now at Intel.
If there will be a JK for software, I'd say if he lands in a typical dotcom, half of the dev team with careers typical to Facebook/Amazon/Google will be relieved of their duties in a week.
I's say it is even less likely if Jim will be on the board
And then there's also "Intel is Removing End of Life Drivers and BIOS Downloads"[0]. Great, if I didn't save them, I need to go to a 3rd party site, run the risk of getting malware, have to compare hashes, etc, etc, etc... This is, in my opinion, an absolute no-go as a vendor, and instantly makes me want to drop them. Which I did, all the PCs my clients get from me are AMD systems now.
AMD is a serious vendor, you can even get the old ATI RAGE drivers off their website.
[0]: https://www.bleepingcomputer.com/news/hardware/intel-is-remo...
EDIT: The linked tweet[1] in the article mirrors my sentiments on this topic almost perfectly:
> "DEAR COMPANIES THAT MAKE HARDWARE: YOU'RE SUPPOSED TO HOST YOUR DRIVERS UNTIL THE SUN EXPLODES OR YOU GO OUT OF BUSINESS, NOT UNTIL YOU GET TIRED OF HOSTING 20 MEGABYTES"
But, isn't it a pretty narrow market that benefits from Intel's tooling here?
Startups running their entire business on JITed runtimes on top of multiple layers of virtualization in cloud providers aren't using this. Enterprises with enough resources to revise their entire stack to work on ARM (Cloudflare, Microsoft, Google, Amazon) likely have the internal resources and skills already to build the missing tooling and profile statistically using massive fleets of servers.
How large is the target market of Intel purchasers that are large enough and performance sensitive enough that it's profitable to micro-optimize assembly, and yet not large enough that it's a rounding error to build similar tooling for AMD x86-64 or ARM or otherwise?
And we (Netflix Open Connect) kind of fit that middle ground that you're talking about.
Have you tried JTAG?
> How large is the target market of Intel purchasers that are large enough and performance sensitive enough that it's profitable to micro-optimize assembly
I'd like to think if a large customer picked up the phone and called Intel and asked why the new processors they got are slower than the old ones, that asking that they send someone to take a look at it would not be outside of the realm of reasonable requests. But not being in a position to buy millions of dollars worth of gear from Intel so I'll have to wait for someone to tell me what happened.
If they bother to send someone out, that person would probably like to have - or even insist on - some decent tools. Reliable and informative, if not necessarily friendly enough for consumers.
I wonder to what extent Intel's tools prevent such customer visits, versus being made to give small and medium sized customer a feeling that they have some secret weapon using Intel, rather than the reality of one. A pretty collar for the pig to wear to the Fair.
Hold on, is that 30% improvement from 3-6 months ago? I thought it was 200Gb/s last time and it was sort of pushed to the limit with memory bandwidth bottleneck? Do you think you can push it even further something like 300Gb/s?
Seriously this is mind boggling.
If we were serving plain http without TLS, we could probably reach 400Gb/s from this box (based purely on back of the envelope math)
The lookaside accelerators (like QAT) sit on the PCIe bus and DMA plaintext into the accelerator, and DMA encrypted data out. This offloads the CPU, but it does not help with memory bandwidth. Since memory bandwidth is our biggest bottleneck, they don't help.
Inline accelerators are "smart nics". The NIC DMAs a pre-formatted TLS record in plain text inside a (series of) TCP packet(s) from the host, encrypts it, and sends it in an almost stateless way. This is what we call "NIC TLS" in FreeSD. Sadly, the inline accelerators we've tried all have fatal flaws which prevent us from using them. I cannot get into those flaws for NDA reasons, but we're hopeful that there will be one that we can use soon.
I know Vtune for Linux exists but I've never heard much a bout it, everyone seems to be recommending "perf". Is there more to measuring memory bandwidth than multiplying last level cache misses with cache line size?
I think where Intel does best is their open source drivers, tools and contributions, though AMD has improved a lot in that respect too.
Yeah adding "period" to a sentence like that totally makes up for the lack of data backing it. AMD spent years in the red and they didn't disappear. I looked it up and Intel cash on hand for the quarter ending December 31, 2019 was $13.123B, a 12.64% increase year-over-year. That's about two quarters profit. Their debt to equity ratio is 0.33 which is on the lower end. They could double their ~29B debt if badly necessary and still be considered a good investment. That two together makes for one gigantic war chest...
Nvidia: 0.21 AMD: 0.17
https://www.macrotrends.net/stocks/charts/NVDA/nvidia/debt-e... https://www.macrotrends.net/stocks/charts/AMD/amd/debt-equit...
Though as we have all come to learn, the market these days is more exposed to perception buying and selling over more robust analytical buying and selling. That and a little dynamic movement can easily amplify by automated trading and reaction trading.
AMD can only gain traction in the graphics consumer market and that may well pan out, though much seems to be riding upon RDNA2 and that is looking like late in the year, this with new consols scheduled for end of the year and that was prior to recent supplier dynamics may well well see those slip into next year.
We have seen the larger datacenters start to take note of AMD more and iirc cloudflare as well as Google buying some AMD offerings in more earnest. The time for those to traction won't be instant either, so any growth will be a while until measured.
But AMD from most people you talk with, seem to be in a good position and it has been a while since they had that postition (decades really), they seem to keep that momentum going and have a path to do that. So even if they don't start to make fast inroads into the datacenter, they are slowly gaining momentum and Intel is loosing momentum.
However, the recent supplier dynamics due to the recent human malware will impact all. So many aspects that make it hard to call, but however it goes, I don't see AMD nor Intel worried more than any other company. Though AMD may well be more exposed to supplier chain dynamics more than Intel and that advantage to Intel (having own fabs) can only sit in Intels favour.
However, the real one to watch will be RISCV and also ARM and recent developments by Fujitsu with the A64FX (well worth reading about as very interesting) stealing the TDP crown. Things may well get very interesting, though in technology, it always is and that is why we all enjoy and love it.
Also worth noting that the recent human malware will see a drive in working from home and that may well shift buying requirements for many businesses, which could see an increase in datacenter usage, though that will be at the expense of local buying.
As always, many dynamics, but perception does seem to be more of a factor than any common sense when it comes to markets. Though the real winners, will be storage and that is an area that gets overlooked and will have an impact more than anything else in the year ahead.
There's no new market here, just intensified competition and Intel has 7nm in the pipeline late 2021/early 2022, that's how far they need to survive on the venerable 14nm and the totally broken 10nm process.
How are people finding AMD hardware in the real world wrt Linux on say 4.19 or 5.4 kernels?
> Guenter Roeck: The information is available from AMD under NDA, which is why Windows tools like HwINFO support it. The added Linux support was largely possible due to what I am sure are unintentional leaks by AMD, mostly in AMD's Linux kernel graphics code. Unfortunately, they learned; the latest version of their graphics code include files no longer provides temperature sensor addresses for Zen2.
[1] https://www.phoronix.com/forums/forum/hardware/processors-me...
I have a bunch of VMs on it, multiple-GPUs, and a bunch of disks. It does exactly what I want, and I'll be upgrading things next year or so.
(To those who love NVIDIA on Linux: I get it. However, Linux needs to move on from X11 and the old, broken, fragmented graphics driver “model.” NVIDIA will always be a second class citizen on Wayland until they change their tune regarding open source. But hey, maybe they’re OK with losing Linux and Mac users, and if that’s their position I’m perfectly happy losing them.)
More like Wayland will always be a second class citizen on machines with NVIDIA cards.
Do you know if Ubuntu 20.04 will be using it by default?
https://www.logicalclocks.com/blog/welcoming-amd-rocm-to-hop...
Performance ain't so bad on AMD GPUs anymore - and none of the EULA crap. Just buy a Vega R7 for 500 bucks and get 16 GB of memory and the performance of close to a 2080 Ti (for convnets, at least) - but with no data center restrictions:
https://github.com/ROCmSoftwarePlatform/tensorflow-upstream/...
For example I was able to run fast.ai/pytorch oh my amd gpu https://github.com/briangorman/fastai_rocm_docker
I wasn't exactly thrilled to see yet another GPU interface, but they seem to be trying to match the CUDA way of doing things. That ought to make supporting AMD much easier than it once was.
No building necessary BTW, just use the 5.4 kernel from backports.
From the other side of the FOSS isle I can report that I have had zero issues under FreeBSD with: 1600X, 2700, Epyc 7002
FreeBSD & Linux both handle the Rx580 line of video cards without a problem. (including 4k@60Hz)
If you use their integrated graphics (as on laptops, etc.) there are sometimes driver hiccups (for example, sometimes a feature that's discrete GPU specific will be problematic with the integrated graphics but enabled by default), or slowness to shut down.
Besides that, of the three Ryzen machines I use regularly they're all fine daily drivers, but sometimes have fixable boot/kernel configuration oddities that vary by kernel release.
Based on this, I'd stay away from 2000 series with integrated graphics, but otherwise am pretty comfortable with the platform.
I've also got a new 3700X and that's been completely stable.
Mixing different generations of cpu's makes it very hard to allow live migrations/failover of certain workloads if they depend on instructions or features that are present in some CPU generations and not in others. this gets even more confusing if you look at the product segmentation intel does on it's cpu's. Newer CPU's might not support all features older cpu's do for instance.
I don't disagree. I was just trying to point out that it is pipe dream to think that VMWare would ever support clustering Intel and AMD together when you can't even cluster differing Intel models together.
People running VMWare don't even consider that.
Most people have that as a goal which they aren't achieving (and that's fine).
I would doubt there's any company in existence actually attaining that goal.
It does offer some amazing capabilities for making old legacy applications that were never designed to have any semblance of failover or redundancy or disaster recovery operate in impressively resilient ways. You also pay for the privilege.
having clusters with the same configuration is useful because it allows vcenter to migrate virtual machines to another hardware host without any downtime on the VM's part.
you can read more about this here: https://blogs.vmware.com/vsphere/2019/07/the-vmotion-process...
This was at the time of the first generation Opteron CPUs (single core), which could be configured in a dual socket motherboard in a 1U server. They had a good price/performance advantage over Intel, which was also at the time a single core per socket.
Around 2006 or so Intel started pulling ahead and AMD never really caught up.
With the development of things based on the zen/zen2 cores, now may finally be the time...
...never really caught up until a couple years ago when Epyc was launched. Then, with the speculative execution security issues that have cropped up, Intel has not only stopped gaining performance but has actively lost performance. AMD has a significant improvement now in price, performance, and definitely price/performance compared to Intel. The biggest thing keeping Intel afloat right now is inertia.
Intel's much better prefetcher let them get away without having an integrated memory controller. https://www.anandtech.com/show/2045/5
https://en.wikipedia.org/wiki/Opteron
section 3.1 and 3.2 there has the original single core opterons. At the time in 2003/2004 they ran circles around the single core xeons, where a two-socket motherboard meant two cores. This was the same era as the Socket 604 Xeons.
Every time AMD had a good architecture that could steal market share, Intel just slashed prices until AMD was put in the place. Intel had good profit margins and and AMD was always struggling. AMD never had a change.
This time AMD is nofab company and TSMC has edge over Intel at least few years.
Here, it simply means 'fitting'. It is a statement of opinion, not legal fact.
i.e. "the sports champion finally claimed their rightful place in the hall of fame."
IMO we'll see the bigger hosting players (Google, Amazon etc.) offer competitive prices on their many-core plans and sooner or later the other players will either have to relax their prices or start losing even more customers to the cloud offerings.
I could be wrong though. Many customers are hell-bent to never host in the cloud and I'm pretty sure that decision makes total sense in their context.
We'll see how things shake out but as a programmer I am seeing a slow but steady shift to making the software (languages and frameworks) multicore-friendly. It's happening with a glacial pace but it does happen.
That being said, your organization's problem isn't AMD vs Intel, your problem is Oracle. If your org spent the money you currently spend on Oracle licenses on a bestial monstrosity of a I AM BECOME DEATH DESTROYER OF WORLDS machine running postgres you'd have better performance. Regardless of whether it's AMD or Intel. (although you're probably better off with AMD)
I know it's not that simple. Just sayin'. Making sure HN meets its daily Oracle hate quota. Seriously though, Oracle sucks.