Intel Refreshes 2nd Gen Xeon Scalable, Slashes Prices
fuse.wikichip.org
fuse.wikichip.org
I was just again pricing processors and if that 7302 isn't the real killer in the Epyc lineup I dunno what is. It craps on pretty much anything and everything Intel has, and is only about $1100 right now (pricing is inflated, but meh).
It's pretty crazy how cheap hardware is compared to the cloud these days; sure, it's not in a data center or if it is that's a headache of its own... but it is really fucking cheap. I personally think a lot of mid-sized orgs could benefit from moving a lot of their non-production environments to an on-prem server. The VPN is probably already locking people out, causing connection headaches anyway, so it's not like you're gonna have less connectivity than you did ;-)
Startups do, and always should, focus on getting to market faster so they can get feedback from real customers.
I will take going to market faster over saving a few dollars on server costs everytime I'm given the choice.
Mature products' and companies' use cases are more nuanced.
Let's not go crazy, Apache on metal is a very simple setup and at least as secure as S3 out of the box. Platform spread and simplicity are just lost concepts, that's all.
I'm curious if people are running bare metal web servers. I'd think there's enough lookup, modules etc that it wouldn't be worth it (small embedded applications like IoT frobs excepted)
> OVHcloud Best Value is a great way for you to experience the advantages of bare metal over virtual servers at an unbeatable price. Our Best Value bare metal servers feature the most stable environment, making it perfect for processing large volumes of data.
The terminology is "bare metal" when buying up dedicated servers these days. Some places still use the term "dedicated", but since the advent of "the cloud", the term "bare metal" has come up, since most instances are ASSUMED to be VPS.
“Bare metal” has meant right on the bare hardware (silicon) since the 1960s. I don’t think I’ve ever heard anyone use that expression in any other way.
https://en.wikipedia.org/wiki/Bare-metal_server https://www.ibm.com/cloud/bare-metal-servers/hosting-solutio... https://www.ionos.com/digitalguide/server/know-how/bare-meta... https://www.rackspace.com/library/what-is-a-bare-metal-serve...
This comment is claiming way too many victims. Shame, it'd be a rather exciting experiment!
Startups are very likely to fail before they need to scale. So that single-threaded C++ server, or whatever it is that the existing engineers are fastest at creating, is fine to get out there and get early market feedback.
The way I always balance this is to make the product manager put scaling and redundancy stories in the queue with feature stories. We'll build with scaling and redundancy in mind, but we don't do any extra work until the business decides those things are a higher priority than testing new hypotheses. And then I have them buy it in increments, so we can add automated load tests as we go. Then if we were to get into failwhale territory, it'd be a decision we all made together.
We had a business in one year and were acquired by a major Portuguese company, with luck the company did survive the crash, and exists nowadays as Altitude Software.
Some of the founders of that startup, left after a couple of years and founded Outsystems.
No cloud, no scripting languages with kubernetes scaling to fix lack of performance, no containers, no internet scale document databases.
Just pure C and C++, with a bit of TCL thrown into the mix, and Apache.
Absolutely. But are you telling me that a $5 p/m LAMP stack from a basic web hosting company (I'm a Microsoft dev so not sure what the FoM in Linux-land is) isn't worth it as a first step? That you have to use a bunch of bells and whistles from AWS or Azure or something?
And, if you're in the MS camp, surely a $10 p/m IIS/SQL hosted option is much easier than anything the big three have...
I'm not seeing the value proposition of cloud here...
It'll certainly take less time to manage than Kubernetes, that's fore sure.
> optimizing for a single server is a waste of resources
No, I think you should spend your time wisely and actually building your product. I don't think you should spend a huge amount of time to "optimize for a single server" (whatever that means), just that a single server can be enough for a large amount of traffic.
Many startups go all-in on complex architecture, microservices and Kubernetes from the get-go (or start splitting their monolith or whatever before it's necessary) and lose a huge amount of time setting all this up (when only Netflix-sized companies really need it) at a time where they should've focused on building their product.
The point here is that you can easily scale most apps in small steps without having to indebt yourself with complex architecture from the get go, which requires having to spend huge sums of cash on sysadmins and AWS bills that don't benefit your users.
For startups I personally believe in the more hybrid solution. I would use a cloud provider and manage the vms myself. For 100 dollars a month you can run 4 vms and a load balancer. Perfectly fine for even most scaleups. Aws, gcs and also azure are money pits. These companies to me resemble the oracle kind of company. The same btw goes for all these tooling companies like hubspot, Salesforce etc. Attractive in the beginning, but bloodsuckers after you become bigger.
This has to be hyperbole right? In any startup labor and rent is the dominant cost, not compute and other SaaS products.
This is just like when they got rid of secretaries. The work didn't go away, it just got moved to all the peons.
> Most of these startups in Soma could run their product on a single threaded C++ server.
Most could be run on a single threaded Python server.
Renting managed, dedicated servers is very inexpensive compared to cloud.
And once you factor in the price of the whole system with ECC RAM, SSD, Network Adaptor etc ( Which you get discount from Intel's part ). The whole package cost isn't so much in flavour of AMD.
So I dont see what is the real killer here. Intel ( And arguably AMD ) are still selling as many as they could make. The EPYC 2 was announced Mid 2019, and it has been 6+ months since it was launched, and yet Intel is still making record Datacenter revenue. With EPYC making minimal gains on a already dismally small base number. I.e Even If they had 100% increase in shipment from a Base Market Share of 1%, it would still only represent 2% of the market.
With the launch of a competitive Notebook APU, where Notebook represent 70% of today's PC market shipment, the assumption of more EPYC Orders with four HyperScaler, launch of two new console, Ray Tracing GPU, new GPGPU, AMD is forecasting 30% YoY revenue growth. Different people may have different perspective on this number. But I really dont see any "Real Killer" here.
And that is speaking as someone who really wants to see AMD to grow a lot more, but the Data suggest otherwise.
If you're doubting the value and performance, you must be blind.
Define Change? EPYC has been sampling to all HyperScaler since early 2019. And Google has only just released an EPYC instance days ago.
>If you're doubting the value and performance, you must be blind.
I already gave a value analysis, including AMD's own projected growth. I will leave others to comment on other aspect of your comment.
The simple fact is the server market moves slowly - server roll outs are planned a year in advance, so you need to be patient.
By “the cloud” I’m assuming you mean aws/gcp/azure, and comparing them simply with on-prem is a false dichotomy. There are plenty of other cloud and bare metal hosting providers who actually pass on the savings as hardware value improves.
It would help them and us if you would list them. :)
Currently renting a dedicated 48-core + HT (so 96 virtual cores), 64GB RAM, 2TB SSD, 10Gb WAN right this moment for ~$500/month as a buildserver.
That would cost 10x on AWS/Azure/GCP.
I hope to be able to come up with amazing wordplay like this one day.
Plus, if I have 16 more cores I'm just going to buy even more of the two, sometimes I can't fit any more in the server so I can't increase my density if I wanted to.
Here's the 64-core Threadripper's core to core communication latency: https://pbs.twimg.com/media/EQXru3WU8AAV3JC?format=png&name=...
Communication within a CCX is quicker, but everything else goes through the central IO die that has all the DRAM controllers.
Cache is shared by the cores, but may be temporarily "assigned" to a core that recently wrote to it. Is the latency(x,y) the "# of cycles to reassign to x a cache page owned by y?"?
Not really. All three levels of cache are split on Rome. L1 and L2 are per-core, and L3 is per-CCX (4 cores). If you have 1 thread with a working set larger than the 16MB L3 slice that each CCX gets, then you'll be hitting DRAM rather than spill over into the L3 of another CCX. But if you have cores on separate CCXs that are using the same region of memory, then the usual cache coherency semantics for separate chips applies.
The next version of AMD's Zen architecture is expected to increase the CCX size to 8 cores, so all 32MB of L3 on an 8-core chiplet will be unified and shared between all 8 cores, rather that being partitioned into two 16MB per-CCX chunks. I don't think it's practical for them to unify the L3 cache across multiple chiplets given the performance of their inter-die connections, and I don't think they have the die space on the central IO die for a fully unified L4 cache. (Shrinking the IO die to 7nm may make it possible to have some L4, but probably not enough to really help many workloads.)
Still, 4MB per core is a lot more than the paltry 1.3MB Intel's 9282 offers.
You can configure Rome systems with 1, 2, or 4 NUMA domains per socket (NPS1, NPS2, or NPS4, where NPS == "NUMA per socket".) Memory bandwidth is higher if you configure as NPS4, but it exposes different latencies to memory based on its location.
It's really impressive that you can get uniform latency to memory for 64 cores on the 7702 chips (when configured as NPS1).
https://www.dell.com/support/article/en-us/sln319015/amd-rom...
Saying that memory bandwidth is higher when configured as NPS4 probably isn't universally true, because that setting will constrain the bandwidth a single core can use to just effectively dual-channel. For a benchmark with the appropriate thread count and sufficiently low core-to-core communication, NPS4 probably makes it easiest to maximize aggregate memory bandwidth utilization (this seems to be what Dell's STREAM Triad results show, with NPS4 and 1 thread per CCX as optimal settings for that benchmark).
You can put this part in "NPS1" mode which interleaves all channels into an apparently uniform memory region, however it is still the case that 1/4 of memory takes an extra 25ns to access and 1/2 of it takes an extra 10ns, compared to the remainder. Putting the part into NPS1 mode just zeroes out the SRAT tables so the OS isn't aware of the difference.
But don't take it from me. AMD's developer docs clearly state, and I am quoting, "The EPYC 7002 Series processors use a Non-Uniform Memory Access (NUMA) Micro- architecture."
Please quote something that's unambiguously supporting your claims. What you've quoted is insufficient.
What I said about a single-socket Rome processor is not "completely incorrect" under any reasonable interpretation. The latency and bandwidth limitations in moving data from one side of the IO die to another is much smaller than the inter-socket connections that were traditionally implied by NUMA, or the inter-chiplet communication in first-gen EPYC/Threadripper.
If you want to insist that NUMA apply to even the slightest measurable memory performance asymmetry between cores, please say so, so that we may know ahead of time whether the discussion is also going to lead to esoteric details like the ring vs mesh interconnects on Intel's processors.
So what ???
The initial posting was about the CPU being seen as a single or multiple NUMA node by the software, not about having an equal memory access latency for all cores, which has never been true for any server/workstation CPU, from any vendor, since many, many years ago.
It's a nice looking processor though and probably the only one worth a damn in that line up.
They also support ECC. What's not "well" about EYPC?
After years of ruthlessly milking us I just hope they loose a big market share and become equals with AMD. The consumers can only benefit from that.
Edit: To clarify, I will not argue that intel has a clean record of competitiveness. My point is that they didn't "ruthlessly milk" the consumer with high prices. Instead, they stuck a knife in their own back by charging excessively high prices without sufficiently innovating. This created an opportunity for AMD and motivated them to create something better.
This is...not accurate. Extensive cross-licensing agreements between AMD and Intel formed over the years are the only thing that permit AMD to compete. New competitors are effectively locked out of the x86-64 market entirely at this point. There is a decided lack of freedom to compete in this market at the moment.
Intel has also been found to have illegally engaged in anticompetitive measures on a number of occasions in order to lock AMD out of competing in many market segments.
> I'm finding it hard to escape the suspicion that Spectre and (to a lesser extent) Meltdown is another failure of expertise on the same rough scale as the run-up to the financial crisis, the decades of bad or poorly-justified dietary advice, and the statistical problems in experimental psychology. On the face of it, it seems obvious that speculation + cache + protected mode was a combination likely ripe for exploitation, but the response seems to have been "nah, it'll be fine, probably"? And even if it for some reason wasn't obvious, it's now clear that it actually was the case. So the academic and industrial and bad-boy "security community" collectively more or less let the CPU manufacturers take a flyer on this for, what, a decade?
Intel engaged in a lot of anti-competitive practices, lost a civil lawsuit over it and was fined 1bn by the EU. [1]
They almost killed AMD in the process.
Every company this size with a quasi-monopoly (in a certain segment) will squeeze the market and try to buy or push out competition any way they can get away with.
[1] https://en.wikipedia.org/wiki/Intel#Litigation_and_regulator...
You're talking about the Intel that was used for monopoly practices, right?
Think of market share as a fragile glass or ceramic cup sitting right at the edge of the table. You're usually oblivious cz it hasn't fallen (or you're busy with other stuff). Then you notice it has tipped over and is now in free fall. If you have very good reflexes, as a big market share company, you catch it mid-air (you lower the prices to the point where it prevents the drop from breaking anything). If you succeed, now you have the cup in your hand; it didn't hit the floor, and it didn't shatter. Great. Now you slowly raise that cup back to the tabletop level (you raise the prices back to the same level in a few years) and place it at the table. Done.
- AMD revenue is between $5-10b,
- nVidia, between $10-20b
- Intel, over $50b.
Intel and nVidia can eat AMD alive anytime they want. Invidually or together. Once, or many times.
Except they can't.
1) Since I'm assuming you're talking about CPUs, nVidia can't make x86-64 processors. Only AMD and Intel can. Literally. They can't use that ISA. Maybe they can take them in the GPU market, but again, they probably still can't.
2) Intel looks like they can, and they do in fact have the funds to do it. But that's just not how it works. AMD has decoupled their tapping and design long ago. Intel still hasn't. The speed at which Intel can innovate is becoming very limited. So while they might catch up, and follow suit, it looks like Intel can't "eat" AMD at this point in time. At least not product wise. Maybe in 5 or 10 years, if AMD starts slacking off again.
Intel's still going it on their own and struggling.
What other long-moated industries are going to crack open in the next half-dozen years?
With last-mile internet, the incumbents have made significant capital investments and competitors have so far been unwilling to engage in the sort of long term slow return investment necessary to build out infrastructure. Google Fiber has tried all means to lower the cost of entry and has thus far failed to deliver significant gains and they're unwilling to make the huge capital investments necessary to truly compete because ensuing price wars would make realizing a return near impossible.
With BEVs the problem is manufacturing cost, primarily the cost of batteries needs to drop but the demand for EVs has not warranted dramatic ramp ups in battery manufacturing necessary for that to occur. The supply of suitable batteries is so limited that Jaguar and others have actually had to stop production.
I wish it were that simple. Unfortunately, the incumbents in a lot of places have done so much to make it appear like there is competition when there really isn’t, to prevent localities from allowing new entrants.
It’s a huge problem, at least in the US.
Not to say the prices won’t go down. But I actually didn’t think the reason they were high was due to mature, moated companies. My personal belief is that Tesla would be foolish to rest on their success in such a way when other companies with a lot more resources are surely going to be competing more competently soon.
Tesla’s service reputation is the main reason I still currently drive an ICE. (Before that, it was their laggy touchscreen - my gas guzzler has an iPad on a bracket on the dash, which does not lag.). Also I’m never going to drive something that spies on me; I had the GSM radio transceiver removed from my current vehicle.
AIUI if you do that to a Tesla you never receive future updates, even to features you paid for in advance.
More competition in the EV market is going to be awesome. Right now it’s just a bloodbath where Tesla can basically do whatever they want, because until very recently every other EV was simply hot garbage.
i'd like to do the same to my VW Golf. i bought a VCDS tool to go in and fiddle with the settings to essentially put the gsm module into airplane mode (i think it's verizon telematics). dunno if this will be sufficient though.
i read that just ripping it out causes a bunch of the infotainment system misbehave, etc.
I have a Nissan Leaf and a Tesla Model 3 and both are of comparable quality to ICE vehicles. They are in two different categories in terms of materials finish but neither is bad quality. The fit and finish of both is average to above average in the industry.
So what's poor quality about Tesla's? An what's your basis for comparison?
In terms of $ per "car" I'd also say yes, but that comes down to my own personal preferences being categorically outside of the luxury car market.
Moats don’t have to be malicious or nefarious. Sometimes there are just high barriers to entry to compete.
See tractors with DRM, for instance. Apparently building tractors and a tractor repair/parts network is a very expensive undertaking.