255 karma · joined November 14, 2019
In my experience much of the complexity of numerical software is to enable the search for the algorithm that works well with the problem/data you have. Once you know the exact algorithm you want, it is possible to make a nice clean minimalistic implementation, but that does not mean such an implementation would have been easy at the beginning.
60 words/minute
60 minutes/hour
8 hours/day
5 days/week
4 weeks/month
=> 7 Megabits => 864kBytes . Fits onto a floppy.
What we could express as words, we could fit onto floppies.
https://www.gnu.org/software/stow/manual/stow.html
This was very useful in early 2000s running shared linux machines with a diverse set of software for scientific applications.
On the other hand they had 2GHz Xeon CPUs!
Table 1 in the paper suggests that average read throughput per worker for typical jobs was around 1MB/s.
For example, I think Dean & Ghemawat reasonably describe what were their incentives: saving capital by reusing an already distributed set of machines while conserving network bandwidth. In table 1 they write average job duration was around 10 minutes involving 150 computers and that on average 1.2 workers died per such job!
The computers had 2-4 GiB memory, 100megabit ethernet and ISA HDDs. In 2003 when they got map reduce going Google's total R&D budget was $90million. There was no cloud so if you wanted a large machine you had to pay up front.
What they did with Map Reduce is a great achievement.
But I would advise against scaling horizontally right from the start because we may need to scale horizontally at some time in future. If it will fit on one machine, do it on one.
> The issues of how to parallelize the computation, distribute the data, and
> handle failures conspire to obscure the original simple computation with large
> amounts of complex code to deal with these issues. As a reaction to this
> complexity,we designed anew abstraction that allows us to express the simple
> computations we were trying to perform but hides the messy details of
> parallelization, fault-tolerance, data distribution and load balancing in
> a library .
If you are not meeting this complexity (and today with 16 TB of RAM and 192 cores, many jobs don't) then Map-Reduce / Hadoop is not for you..."10. Finally, disclosure is very expensive. The court will be astute to guard against it becoming either satellite litigation or a weapon in the interlocutory arsenal."
While the incentives are not to reveal evidence the law is absolutely clear that all evidence identified must be revealed. The difficulty is that forcing and unlimited discovery to identify the evidence would break the whole legal system, and this is what parties can hide behind (for a while at least). We'll have to see when and how anybody will face the consequences of any failures to reveal the evidence.
I very much recommend reading the Judgements in Bates vs Post Office. As litigation progressed you can notice how it becomes apparent to the judge how Post Office legal tactics and behaviour undermined the prosecutions.
What the editorial is saying is that both the currently private projects in US to build the new generation of ground telescopes need government money to be completed but it is unrealistic for government to fund both. Therefore the government should pick one to take over and then make sure it has enough money to be built.
Exams are for people designing bridges and doing surgery. Basic science just learn and start doing some to see if it is for you.
It is too slow to reimplement big pieces of software in it, so people just used bindings to existing code. And productivity rocketed!
- Do not write a program if it does not need to be written
- Think about what you are doing before you do it
- Write with care and attention (whether code or prose)
Seems as applicable today as it was then.
- modern iPhones can communicate with global satellite constellations (https://support.apple.com/en-us/HT213885). I imagine this will grow substantially
- Even bike lights nowdays have radar built into them (e.g., https://www.garmin.com/en-GB/p/698001). Also room presence sensors are beginning to use radar 22GHz.
We can now build incredibly cheap and lightweight radio devices up to 80 GHz. They will inevitably be used more on the ground, in air and on satellites as the economics makes new types of uses practical.
Making a much larger mirror would also face another obstacle: the focal length is designed to be practical for a ~40m mirror.
So the test seems to compare one thread of a CPU launched in 2016 running a port of 40year old fortran code to a optimised FFT library on a GPU launched in 2020.
One thing about rust, salt and moisture: salts deliquescence. I.e. they absorb moisture from air until there is enough liquid to dissolve themselves in. This happens below 100% relative humidity (around 75% for common salt, but as little as 31% for cacl2). So salt-contaminated surfaces can easily get wet even when the air is not that humid, bad news for steel!