Nvidia calling gaming PC owners to put their systems to work fighting Covid-19
gamesradar.com
gamesradar.com
[1] https://www.top500.org/system/179691 [2] https://www.top500.org/system/178928
The vaccine(s) are already in phase one clinical trial testing, as are some important anti-viral treatments which are in phase three clinical trial testing.
There is no potential output from this folding project that can accelerate those timelines.
That does however not take away from my main point, if anything it is in support of what I was trying to emphasize: such computational research is better suited for a compute cluster.
In fact, donating in other ways, e.g. giving free programming, HPC etc. education to more researchers can have a higher impact on the long run.
Nothing prevents running the fah client on nodes of a compute cluster -- in fact my colleagues did that (while running a local F@H server), though that was a number of years ago just because they wanted take advantage of the distributed computing facilities provided by the client-server setup and built-in algorithms.
> crowd sourcing has the potential to scale to many orders of magnitude larger than what can be done in a data center.
Potential it does have, but I am skeptical of the "many orders of magnitude" claim ever having a chance to materialize. I'd love to see a cost / benefit analysis on the effective amount of useful work contributed vs the cost of the same in a data center.
The many orders of magnitude has already materialized https://en.wikipedia.org/wiki/SETI@home#Statistics
“On September 26, 2001, SETI@home had performed a total of 1021 floating point operations. It was acknowledged by the 2008 edition of the Guinness World Records as the largest computation in history.[22] With over 145,000 active computers in the system (1.4 million total) in 233 countries, as of 23 June 2013, SETI@home had the ability to compute over 668 teraFLOPS.[23] For comparison, the Tianhe-2 computer, which as of 23 June 2013 was the world's fastest supercomputer, was able to compute 33.86 petaFLOPS (approximately 50 times greater).”
It’s probably worth noting that Seti@home has partitioned the problem space so that it’s “embarrassingly parallel”, as they say. I think raw flops are a good metric in this case, where raw flops is a very bad metric for some problems.
Just to clarify, I think HN formatting ate a caret here (now dang can see in the dark!) and it's supposed to be "10 to the 21"; either that or floating point math is much harder than I remember.
In 2001 SETI@home had more flops than the best supercomputer of the time. In 2013, SETI@home had fewer flops than the best supercomputer of the time.
[1] hhttps://www.cineca.it/en/news/exscalate4cov-hpc-platform-win...
(Also, AFAIK garbage flops also count. As far as I recall talkin to a researcher working with FAH a qhile ago, a large-ish fraction of results returned were not usable due to data/files being broken.)
Oh, that wasn’t really clear to me. Anyway, there is a close relationship between the SETI project and the Folding project, so this doesn’t seem like a weird stretch to me to compare them. Whatever SETI@home has achieved is evidence for what Folding@home might achieve.
> plots available through an easy google search show that in the past it was never even larger than the biggest machines on the TOP500
But that has little bearing on either what’s possible in the future, nor why they aren’t scheduling compute time on Summit, right?
Maybe the best answer to your original question is posted in the FAQ section on folding at home.org: see “Why not just use a supercomputer” https://foldingathome.org/support/faq/project-details/
> Also AFAIK garbage flops also count.
That’s always true in these peak performance measurements, both for distributed projects and for supercomputers too. Also true for CPU & GPU peak flops specs.
We can’t actually know how much ‘useful’ work is being done in any case, that depends on all kinds of things like what kind of problem is being solved, how data-parallel the problem is, how well the problem is even understood, what algorithms are being used, what bottlenecks there are on data & IO, whether the implementers used python or CUDA.
I just don’t see any reason why Folding@Home would or should refrain from distributed crowd computing just because supercomputers exist. They can both happen. We don’t need to try to come up with efficiency numbers or compare utility/flop in order to see that Folding@Home is producing some useful research results, right?
Maybe it’s worth pointing out that compute time on TOP500 supercomputers is not free, and Folding@Home is not a job you can run for 1 day or 1 week and be done. Nvidia or IBM could donate some time, but it won’t finish the project, so it might make no sense to donate supercomputer time, just like it makes no sense for Folding@Home to seek out or purchase supercomputer time.
There is certainly a chance that 10-100x more flops will appear on the fah network, but as I said I just don't believe it will happen.
> nor why they aren’t scheduling compute time on Summit, right?
They are. The researchers who get to use the FAH network certainly do have access to traditional supercomputing resources too. Some types of problems require strong scaling (and reliable resources) which requires HPC iron.
> > Also AFAIK garbage flops also count.
> That’s always true in these peak performance measurements, both for distributed projects and for supercomputers too. Also true for CPU & GPU peak flops specs.
I think you're misunderstanding me: I literally meant that the data files returned by the FAH contributors may often be garbage due to data corruption (OC'd cards, no ECC, overheating hardware, poor storage etc.). Not sure to what extent is this still the case today.
> I just don’t see any reason why Folding@Home would or should refrain from distributed crowd computing just because supercomputers exist. They can both happen. We don’t need to try to come up with efficiency numbers or compare utility/flop in order to see that Folding@Home is producing some useful research results, right?
In principle you're right. There are some questions around it, though. Briefly: access is a privilege of few; oversight?; inefficient use of hardware (low Flops/W), just to name a few.
> Maybe it’s worth pointing out that compute time on TOP500 supercomputers is not free,
No, it is not, but access is granted by grant agencies with at least some transparency and oversight as well as scientific review; also, those machine are far more efficient (flops/w).
> and Folding@Home is not a job you can run for 1 day or 1 week and be done.
No, Folding@Home is not the "job"; a "job" at least in HPC sense is a molecular dynamics simulation (or many); a set of such jobs is what is typically required for a project to be completed result of which would end up in a publication. The computational work corresponding to such a project/paper, depending on the size of the machine, can in fact be run in 1 week, and on a large machine even in 1 day.
Its like driving through some burger joint where they ask you to spare change for the needy... since you know, you have so much money, and the burger joint can not possibly afford it.
The F@H team COVID19@REDDIT[2] has ID 236269, if you are interested to join.
[1] https://www.reddit.com/r/COVID19
[2] https://folding.extremeoverclocking.com/team_summary.php?s=&...
Also the web client shows information about the executing tasks (e.g. [3][4]). The COVID19 tasks are prioritized and will be executed when you keep the target settings of the client at default ("Any").
[1] https://foldingathome.org/2020/03/10/covid19-update
[2] https://twitter.com/foldingathome/status/1238568504200253442
None of the results linked above are immediate disease cures, but that's normal. Most research is an unsexy sequence of small increments of progress.
Which is fine for basic science, I'm sure there's a possibility some of these folding experiments will lead to insights of actual use in the long-term. However folding@home et al disingenuously portray this immediate effect on curing aids or the latest scare, which I doubt is truly that useful.
I'd argue that this simulation research is as useful for covid19 therapeutic research as banning plastic straws is to solve global warming.
I will say that there's nothing wrong with continuing the folding research that's being done. We have a ways to go before purely predicted protein structures (as opposed to structures from crystallography or EM) become trustworthy enough to make research decisions based off of. But we can't get there if we don't continue the basic research! In that sense I'm all for these studies. A lab I always appreciate (purely from perceived merit of the papers I see continuously from) is that of David Baker. They seem to make meaningful strides towards making synthetic protein folding more powerful as a tool among other projects.
However what I see as problems are two things in this field:
1. Definitely have seen papers where they'll try to do some molecular Dynamics simulations on some protein related to a disease but it's not clear if it's meaningful to anyone - people actually working on the disease therapy probably weren't even asking for these insights if there were even any; these low-hanging-fruit studies also don't aid the progress of folding and Dynamics research either, because they were just applying standard techniques to a problem domain. Often times these are just cash grabs by researchers who have specialized in the mol.dyn fields and end up writing grants to disease research agencies allegedly in aid of curing the disease but practically not. I know this because my lab did this blatantly. When anthrax was a real threat we got funds for anthrax related research, then we shifted to MS, now cancer. I wouldn't be surprised if they suddenly write grants for corona virus related research! This goes on in all these fields.
2. I argue that folding@home keep advertising misleadingly that they're gonna help cure aids or corona or whatever. I don't think they are, not directly. In a very vague way this feels more like war profiteering to me - these experts are exploiting the current fears to canvas their projects (even design them around this) and giving what is closer to false hope than anything that people are contributing towards end goals of curing disease. I feel like they should be honest about it - this is more basic research than anything else, so they should just say they want computational power for basic science. If people still choose to give their resources, great. Otherwise at least you live and die with dignity.
Anyways this is of course a rant from a PhD who got sick of the system and left, and someone with only an associative knowledge of this particular field. Hence these thoughts should be taken with a grain of salt!
But yeah, the md crowd should have tighter communication with the therapeutics crowd!
BTW just because you switch around your research-targets when funding changes doesn't imply that the research is useless. For example right now there is a lot of money funnelled into corona-research (for obvious reasons).
I do agree it's difficult to formulate how to ask for donations (money or cpu-time), you need to seem optimistic otherwise nobody would do it but research takes a huge amount of money and cpu-time and calendar time so there surely is a gap here between expectations and reality..
And there is a tricky balance between over-promising and under-delivering vs being realistic and lacking enough "flashyness" to get funded/thrown money at.
[1] https://doi.org/10.1016/j.celrep.2018.03.10 [2] https://doi.org/10.1016/j.jsb.2018.04.005 [3] https://doi.org/10.1016/j.jconrel.2018.05.026
Either way, in a time of misinformation it’s worth clarifying:
“The main reason cited for eliminating plastic straws is their negative impact on our oceans and marine wildlife. Plastic in the ocean is a huge problem — look no further than trash island, or the viral video of a turtle suffering as a result of ocean pollution, to understand that. But of all the plastic that ends up in the ocean, straws make up only four percent of that waste.”
https://squareup.com/us/en/townsquare/why-plastic-straws-are...
https://foldingathome.org/start-folding/
and started running the client, but...
* The fahcontrol DEB package is not compatible with Debian 10 / Devuan 3.
* There is no APT repository.
I'm willing to do folding@home, but not take-care-of-their-devops-issues@home.
Edit: Apparently, indeed, the folding@home work I would be doing doesn't have much in particular to do with covid-19. I feel a bit cheated here.
kubernetes: https://github.com/richstokes/k8s-fah
https://github.com/pcktdmp/charts
This design pattern is extremely useful when running for instance on AWS Spot Instances.
[1] https://boinc.bakerlab.org/
[2] https://www.ipd.uw.edu/2020/02/rosettas-role-in-fighting-cor...
---- original post ------
I was just trying to get it running on Ubuntu 18.04 in response to this post but I'm just getting a lot of errors with not very useful error messages. Any ideas?
When I run FAHClient manually I get, 21:04:10:WARNING:WU01:FS01:Failed to get assignment from 'X.X.X.X:8080': No WUs available for this configuration
(I replaced the IP address with Xs)
When I try starting the service I get an error and journalctl -xe gives me, e.g., (unedited, it actually says "result is RESULT")
-- Unit FAHClient.service has begun starting up.
Mar 14 22:02:27 poole FAHClient[17956]: Starting fahclient ... FAIL
Mar 14 22:02:27 poole systemd[1]: FAHClient.service: Control process exited, code=exited st
Mar 14 22:02:27 poole systemd[1]: FAHClient.service: Failed with result 'exit-code'.
Mar 14 22:02:27 poole systemd[1]: Failed to start LSB: Folding@home Client.
-- Subject: Unit FAHClient.service has failed
-- Defined-By: systemd
-- Support: http://www.ubuntu.com/support
--
-- Unit FAHClient.service has failed.
--
-- The result is RESULT.
For a more user-friendly UI, you can also go to https://client.foldingathome.org/, which will then attempt to communicate with your client on port 7396 and display the project description among other things. (This also lets you change some settings)
For those running on servers, you can telnet 127.0.0.1 36330 to control your client.
If you just want the project numbers quickly, you can do grep project /var/lib/fahclient/log.txt
That makes the usefulness of CPUs for this purpose questionable—you might be contributing more to that other disaster facing humanity than alleviating the current one.
20-200x is simply not true. Typically, such numbers are a result of comparing unoptimized CPU code to moderately or well-optimized GPU code which is often misleading. (Such differences are however perfectly reasonable when comparing hardware-accelerated workloads like ML/DL). If you compare actually well-optimized codes, you'll see more like ~4-5x difference in performance for FLOP/instrction-bound code as it is the case for well-optimized molecular dynamics.
Case in point, I recently pointed out the huge difference in CPU performance of two of the top molecular simulation codes, one of which is 8-10x faster on CPUs than the other, solving the same problem [2].
F@H relies on GROMACS as a CPU engine [1] which happens to be the same code as I quoted above as the fast one. The trouble is that F@H has not updated their CPU engine for many years and distribute CPU binaries which lack crucial SIMD optimizations to allow making use of AVX2/AVX512 on modern x86 CPUs as well as the years of algorithmic improvement and code optimization we made. These two factors combined lead to _significantly_ lower F@H CPU performance compared to what they had we're they using a recent GROMACS engine.
Consequently, due to the combination of an inherent performance advantage of GPUs and the severely outdated CPU engine, it is indeed not worth wasting energy with running F@H on CPUs.
[1] https://en.wikipedia.org/wiki/List_of_Folding@home_cores#GRO...
[2] https://twitter.com/twilard/status/1235142089156984832?s=20
Edit 1: adjusted wording to reflect that the performance difference between running outdated GROMACS version and subotimal SIMD optimizations on modern hw can have a range of performance difference, depending on hardware and inputs. Edit 2: fixed typo + formatting.
Fair point. I think this is something you should bring up with the authors of Folding@Home. I do not work on that project.
My personal view on this is that there is always a cost/benefit balance that one has to strike which is often tricky especially given the considerably constrained resources as it is typically the case in academic computational/simulation tool development.
It is however, as you point out, a great responsibility of the researchers and developers of codes to make sure that choices made and action taken (or not) do not lead to disproportionate waste of resources donated by volunteers or awarded through a grant by research funding agencies.
I do not know the detailed reasons why F@H chose to not update CPU "core" since FahCore_a7 (AFAIK based one GROMACS code from 2014), but it is likely related to the aforementioned cost/benefit analysis done in their team. One of the motivations could have been (just hypothesizing) that the software engineering efforts estimated to be required to update FahCore for CPUs (which generate a very small fraction of the "points") would have taken away resources from the GPU FahCore.
To that question, assuming by "anyone" here you are asking about other donate-your-cycles-distributed-computing-projects: I am not too familiar with how well-optimized the codes of different @home projects are.
Taking a few steps back, perhaps the efficiency of these codes is the lesser issue and to be honest, in some (many?) cases other forms of donation/contribution may further more scientific progress than simply crunching numbers on one's home PC.
Totally, but if the work done @home is useful, donating compute time makes economical sense I think.
If I'm willing to donate $10 I can either donate money and it may be used to buy $10 worth of compute, with should cover all costs including the hardware and administration.
Or I can donate $10 worth of pure electricity and the other marginals I cover for no or a very small extra cost, since I already own the hardware for other purposes which it's temporarily not used for.
In the latter case the value of my $10 is higher, I theorize. Again, given that the @home project is truly useful.
In that respect, the responsibility of whether to ask for and how to make good use of donations lies solely on the teams that receive the donation. Without oversight it would however be foolish of them to be overly critical on their own shortcomings as there is a great benefit to having these cheap FLOPS (and good PR) that F@H brings.
I was about to suggest that it would be great to set up a merit-based funding scheme somewhat akin to the governamental funding agencies, but one run independently by the "council of the people". I'm however uncertain how effective could such an organization be at awarding the funding in a responsible and effective manner.
GPUs are faster.
"For people worried about electricity usage:
My 3900x/2070s system, if using both cpu+gpu for folding full, uses 430w at the wall plug. Even at 21cents per kw/h this is about 9 cents/h.
When setting up your machine, it's best to go to slots and remove your cpu. GPU tends to make all the points, especially if you have a newer GPU. I removed my 12 core 3900x from slots and barely noticed a drop in points while my system was running much cooler and with even less power usage. Leave it to default disease and you'll likely get covid-19 projects.
I use both my 2070s cards and I get estimated 3.2M ppd for $2/24hrs of electricity.
TLDR: PC's don't use much power. Get folding@home and just use your GPU(s) at full. Leave it to default to get covid-19 projects."
I applied this strategy when bitcoin mining on my 1080ti which I got shortly after release. I was aiming for sub 60c temps. The results paid for the GPU, and I didn't fry it either - still my daily driver today.
(The 1080TI is / was such a beast, with exceptional value for money.)
> No WUs available for this configuration
EDIT after fiddling with gpu-index, cuda-index, and opencl-index (had to manually set them to point to my GTX 1050 [also have a BARTS card that is unsupported]) I was able to get a WU to download :)
GPUs: 2
GPU 0: Bus:1 Slot:0 Func:0 AMD:4 Barts XT [Radeon HD 6800 Series]
GPU 1: Bus:2 Slot:0 Func:0 NVIDIA:7 GP107 [GeForce GTX 1050 LP] 1862
CUDA Device 0: Platform:0 Device:0 Bus:2 Slot:0 Compute:6.1 Driver:8.0
OpenCL Device 0: Platform:0 Device:0 Bus:2 Slot:0 Compute:1.2 Driver:378.49
OpenCL Device 1: Platform:1 Device:0 Bus:1 Slot:0 Compute:1.2 Driver:1800.8
I want to use the GTX1050, so I set gpu-index to 1. Only 1 CUDA device so I set cuda-index to 0. To use the OpenCL device for the GTX, I looked at the bus # (bus 2), found OpenCL device on bus 2 (device 0), so I set opengl-index to 0. Not sure if this is the right way, but it worked for me.https://foldingforum.org/viewtopic.php?f=24&t=32339 https://foldingforum.org/viewtopic.php?f=24&t=32341
All of the really big miners are mining Bitcoin using ASICs.
Obviously, I don't have real numbers, and I could be completely wrong.
I installed it few days ago but got so far random assortment of other tasks and nothing about coronavirus so far.
Thank-you everyone.
https://foldingathome.org/support/faq/installation-guides/li...
The digital solution is stronger: delete Coronavirus RNA. This isn’t dependent on shape of some molecule and how some other molecule docks with that inside a molecular blender. Genome engineering targets sequences directly, works with novel viruses right away, tolerates mutations with wobble base pairs, works in immunocomprimised patients, has potentially zero side effects, etc etc
I applaud these efforts but implore you to consider: why throw a fancy molecular wrench into the virus machine when you can instead set the “virus switch” to “off?”
If anyone’s gonna grok the benefit of digital over analog, it ought to be the Hacker News community. The hardest part is delivery, we need to affordably mass produce nano particles with the CRISPR DNA inside. That’s the number one thing holding back biotech from curing many diseases including this one: AAV is the standard vector but it only works once before you’re immune to the gene therapy.
here’s a link to a repo (WIP) to target nCoV with CRISPR https://github.com/bionicles/coronavirus
If you can help mass produce nanoparticles with microfluidics or self assembly please email me bion@bitpharma.com
Folding At Home is cool. Is folding and shape-medicine the best way to cure human disease? How do we know the answer to that unless we try to program cells like we program computers?