HP Updates Z8 Workstations: Up to 56 Cores, 3 TB RAM, 9 PCIe Slots, 1700W
anandtech.com
anandtech.com
Edit: I guess I should be clear and say that the simulations themselves are running on a commercial software package (Fortran based) and I'm simply setting them up, spinning them off, and then processing all of the resulting data in Python.
Really curious. I deploy code to a large production server cluster, my friends in academia submit code to large scientific computing clusters, but I don't know of anyone with this much power in their own desktop. I guess I've been in video edit suites with machines much more powerful than the average PC, but not this crazy.
A lot of battle-tested engineering software doesn't do distributed-memory parallelism well. I've personally used MCNP and GEANT4 (particle physics software) on a 48 core, 1 TB RAM workstation. It's interesting browsing the web while the computer is running gigantic calculations in the background on two [physical] CPUs, hooray for the process scheduler doing a good job.
As a remote employee it allows me to most of my development locally, and then use larger environments for a shorter period of time later on.
Combine 3 or 4 of them, and I can have an actual cloud running under my desk, for testing things like kubernetes deployments, with enough capacity for a few concurrent test environments.
As I said above they run basically silent, so I can use them in a shared office space without annoying my neighbors.
I've been hearing of people buying Mac Pros for cloud demos so they can run VMs on them locally because they're among the most compact, compute and memory dense systems you can buy.
I had access to racks of hardware to do a lot of testing but they were in Colorado, while I am in EU which made latency a real problem.
Running inadequate machines waste time of otherwise expensive engineers. The other day I was giving a live demo of an interception proxy and accidentally clicked on a very large HTTP response. The machine I was using only had 32 GB of RAM so I had to open task manager and kill the app so I could re-start it because the meeting would have been over by the time it loaded due to disk caching.
Basically 3D rendering.
Imagine doing web dev in a language where you refresh the webpage to see if it worked vs having to run a long build. The former is better, even though it's not really as good as careful reading of your changes, but there are many times throughout the day when you just want the compiler to bark at you to clear any stupid type or syntax errors. The faster your machine and more parallel the build, the closer you get to that web dev experience.
Having access to machines remotely can replace some of that, but it definitely costs time.
It's funny the things that need a lot of beans to run; I was sitting with one of the GIS guys and he just clicked a button which then caused all 24 cores on his rig to flatline for about 4 minutes. The end result? A map of our city suddenly had a few boxes drawn over the top of it. As it turns out he was pulling in data from half a dozen sources to map out areas where there was government run housing that experienced higher than average levels of emergency services call outs. Apparently, in the past doing that manually would probably have taken several people about a week to do and wouldn't have been as accurate.
Supermicro X10DAI motherboard is just a piece of art, as usual. They sell you this brand new beauty for $350 - it is more like running a charity given the fact that those so called "high end" consumer grade motherboard with one socket and 8 DIMM slots can easily cost you $500 or more.
RAM is pretty expensive now, 128G DDR4-2133P ECC REG RAM cost around $1,000 on taobao.com, unless you buy some shitty brands to save a couple hundred $. Then you need a EEB case, a solid reliable PSU and two heatsinks, that is another $250 to spend.
I can't afford a 3T RAM HP workstation, but the good news is every programmer in fact can afford a 44 cores dual E5-2696v4 workstation like the one I just built. ;)
I bought everything for a dual Xeon 2670v1 system (starting with Dell T5600 as base) from ebay and it came out to $1000 last year including $150 for 64GB of ECC RAM.
Very happy with it but could definitely use an upgrade now.
Dual E5-2696v4 seems like the current sweet spot for DIY.
pretty happy with my experience. vendors posted the stuff on the same day, delivered within 24 hours as I live in Shanghai. it might be different story if you live in other countries as the refund policy says you can return the stuff within 7 days with no questions asked, you probably can't do that within the 7 days time frame if the package need to be posted overseas.
> I bought everything for a dual Xeon 2670v1 system (starting with Dell T5600 as base) from ebay and it came out to $1000 last year including $150 for 64GB of ECC RAM.
I also have a dual E5-2670v1 system, actually I am posting from it now. I found a single E5-2696v4 is going to be 40-50% faster than the dual E5-2670v1, dual 2696v4 almost triples the CPU performance for my workload. this has been confirmed by both cinebench score and benchmark results of an in-house application I developed. RAM bandwidth is not going to be a big jump.
> Dual E5-2696v4 seems like the current sweet spot for DIY.
Dual E5-2696v3 with some firmware/bios hack to push all cores running at higher speed is probably more $ efficient. You can get a faster system that is $500 cheaper. ;)
I wonder how easy it is to receive Taobao merchandise in Europe. It appears you have to go through an agent.
Last year I picked up a Dell T3600 with a Xeon E5-2670 (V1 - 8C/16T) and 32GB ECC RAM for €400 delivered. It's not completely silent (maybe HP are better in that regard based on comments here?), but it doesn't make much noise - at least compared to what you'd expect from the power it gives.
I now work from home, and having previously primarily used laptops, this thing feels like a beast.
that stuff was $150-200 delivered if you buy from taobao.com.
people also need to realize that dual e5-2670v1 has a cinebench score of 2,000, that is just slightly highly than a single ryzen 1800x.
I checked prices for sourcing my own hardware on the same platform, but it would have been a lot more expensive. The problem here in Europe is there is less second hand enterprise hardware available (if I remember correctly, a compatible motherboard alone would have been ~€200, and the RAM was about the same) and importing something from outside Europe means you need to pay customs fees, which in my country adds ~30% to the price.
https://hardwareisboring.blogspot.com/2016/06/hp-z440.htm
And yes, completely silent. Only hear the GPU (upgraded to 1070gtx) when playing demanding games.
I've built plenty of gaming rigs, but have never been interested in this world until recently... and would appreciate any insight :)
[0] http://www.techspot.com/review/1155-affordable-dual-xeon-pc/
[1] http://www.techspot.com/review/1218-affordable-40-thread-xeo...
Instead of just buying a quieter computer (or upgrading it)?
How is it so problematic to have cables running along the molding and around a corner?
In fact, why bother worrying about the noise anyway? Some people function much better with white noise in the background.
It was dead silent. I could hammer all the cores, RAM and disks, and not hear anything from it.
At one point I had 4 of them under my desk, and there was more noise from the MacBook Pro.
I am kind of playing /w configurations to see what I can get.
Surprised the Radeon Pro SSG isn't an option. It's basically the WX 9100 with 2TB of flash memory slapped on that you can use as VRAM:
https://pro.radeon.com/en/product/pro-series/radeon-pro-ssg/
It requires special application support, you are 100% unlikely to ever discover an app in the wild that can use it.
"ProRender plug-in for Maya has full support for the out-of-core rendering feature found on the Radeon™ Pro SSG which allows the application to tap into the full 2TB of memory found locally on the card. This allows users with very large models to render fully accelerated by the GPU. "
I was hoping transistor become so cheap, 8GB should be the norm and 16GB for mainstream, anyone with serious needs could get 128GB+ or even 1TB.
Instead our memory prices has been trending upwards, slightly improved energy efficiency and still no ECC.
Why? I thought memory were supposed to be commodity.
Tounge firmly pressed in cheek..
And those who comment who use them, just so you know I am jealous of you :).
What crazy times we live in. I can't justify buying one of these. I keep tying to come up with a good reason. I suppose YouTube would finally run smoothly.
Is it an issue of "overpowered" fans (for really hot rooms), or is it really just an issue of "cheap as crap" fans by OEMs?
Image processing needs as many cores and RAM as you can give it, and local will beat AWS-esque until we get fiber everywhere.
Any applications that can would be either run on clusters of servers to really parallelise the work, or is so custom you may as well buy a threadripper and a custom case.
Hell most apps can barely take advantage of multi core CPU.
While you are right that there are very few apps able to take advantage of quad GPUs, for anyone who does serious number crunching it’s not a problem at all to use all of them using popular deep learning frameworks. They aren’t just for deep learning, you can do a lot more with them. And e.g. PyTorch will automatically parallelize certain things across multiple GPUs for you, with near linear speed up.
I wpild be interested to see how pytorch scales GPU wise, relative to CPU clock speed. I am sure there is a point where it will fall off, but not having a 4 GPU system I can't check :)
I have a 40 core CPU machine with a GTX 1080 Ti GPU. I run deep learning models with 90% GPU utilization and those 40 cores are barely used.
I would love to have 3 more GPUs to run in parallel to test different neural network architectures. Sometimes I'll run a CPU script at the same that processes machine learning data that uses all 40 cores.
I would use 4000 CPU cores and 10 GPUs in a machine if I could get them and I don't even do machine learning full time. I'm personally happy to see this trend of more core counts.
Sure you can write code that nominally use all the cores, but I do not think that the performance increase is going to be linair to the core count.
It's not even down to CPU core count - it would be limited by the speed of a single core.