HNHacker News
TopNewBestAskShowJobs

snewman

4,381 karma · joined January 14, 2011

Repeat-offender entrepreneur; co-founded Writely (aka Google Docs), Scalyr, and others.

steve at snewman dot net

https://amistrongeryet.substack.com/ – AI blog https://climateer.substack.com/ – climate blog

submissionscomments
snewman··on A half-hour to learn Rust
GC also protects you against forget-to-free, which in most non-GC languages is a common form of memory leak.
snewman··on Age-specific mortality and immunity patterns of SARS-CoV-2
The fraction of infections which are diagnosed varies quite a bit by circumstance, e.g. available test capacity. In general I get the impression that 10x was typical early on and 3x may be more typical now.
snewman··on Tasmania declares itself 100 per cent powered by renewable electricity
Look at it this way: if Tasmania ceased to exist, CO2 emissions from power generation would increase, because on average Victoria would need to run their coal plants more. That strikes me as a pretty pragmatic definition of "100 percent powered by renewable".

Edit: per comments downthread, perhaps they're actually not quite there yet, but still I think the principle holds if internal generation is exclusively renewable and net imports are negative.

snewman··on SpaceX Starlink has some hiccups as expected, but users are impressed
In addition to the points made by toomuchtodo, I believe Starlink currently relies on the presence of nearby ground stations to relay your packets to/from the Internet backbone. Eventually they plan satellite-to-satellite hops but I don't think that's enabled yet.
snewman··on AI that mistook a bald head for a soccer ball
Eh, there's nothing new under the sun. The book A Robot Ping-Pong Player (https://mitpress.mit.edu/books/robot-ping-pong-player) contains an anecdote about the robot mistaking Marvin Minsky's head for a ping-pong ball... and taking a swing at him...

See also: https://muq.org/~cynbe/muq/muf3_22.html

snewman··on Maine Becomes First State to Use Ranked-Choice Voting in a Presidential Election
Agreed, the spectrum ultimately is arbitrary. I was thinking in terms of a spectrum normalized to the country as a whole. In a particular district, you often have a breakdown that is off-center relative to the overall nation (of course that can be in either direction).

And in any case, the key point is that the primary process can lead to a candidate taking office who is well off-center even within their district.

snewman··on Maine Becomes First State to Use Ranked-Choice Voting in a Presidential Election
A common scenario in many locations in the US:

A district tilts heavily toward one of the two main parties -- it is a "safe" district for that party. The candidate nominated by that party in the primary election is nearly certain to win the general election. If the candidate is highly extremist / flawed, they might lose, but party affiliation is sufficiently strong nowadays (aka the electorate is sufficiently polarized) that a candidate can be pretty far to one extreme -- farther out than the bulk of the electorate -- and still win.

Meanwhile, there is a tendency for the more centrist voters in both parties to skip the primary. Thus, the candidate who survives the primary is often relatively extreme.

The result is that the victor of the general election is often to the extreme side of not only the electorate as a whole, but the membership of their party.

To oversimplify, imagine that political views fall on a one-dimensional spectrum ranging from 0 to 1, and the electorate consists of:

  - 40% at 0.4 (center-left)
  - 30% at 0.6 (center-right)
  - 30% at 0.8 (heavy right)
In the primary, center-right voters are under-represented, and a candidate at or beyond 0.8 has an excellent chance of being nominated. Then in the general election, at least 2/3 of the center-right voters are likely to swing toward that candidate (because of polarization / strong party affiliation).
snewman··on Monitoring a high risk conjunction between two large defunct objects in LEO
A couple of questions:

1. How likely is it that a collision like this (two large satellites, high enough for the fragments to have a long orbital lifetime) occurs in any given year?

2. This announcement popped up on HN a couple of days before the event. Are we not able to project potential collisions farther ahead? I would think objects of this size are well tracked.

I'm wondering how difficult it would be to detect these far enough in advance to send something up to nudge one of the dead satellites out of the way.

snewman··on Delta-V: Designing the Asteroid Mining Ship 'Konstantin'
Casey Handmer has a great blog taking hard analysis of what activities will be practical in space. He argues there is no real reason for asteroid mining to bring resources back to earth. So the challenge is to identify a large market for resources to be used in space.

https://caseyhandmer.wordpress.com/2019/08/27/there-are-no-k...

snewman··on The Great Barrington Declaration
1. That's the number of deaths given the restrictions. If there were no restrictions then the numbers would be much higher.

2. What is your source for death rates not fluctuating with cases? In general, deaths have reliably tracked cases, with a delay of a few weeks (because it takes time to progress from diagnosis to death).

3. Shuttering the economy is not binary. With an intelligent approach, and general compliance with measures such as mask wearing, we ought to be able to control the virus without a complete shutdown. Unfortunately we keep making unintelligent tradeoffs and executing inconsistently.

snewman··on Is TDD Dead? (2014)
Imagine I am implementing a service that queries 20 separate MySQL database servers to generate a report. (I'm not saying this is a good architecture, it's merely to illustrate the point.) I know that sometimes one of the MySQL instances might be down, e.g. due to a hardware failure. When this happens, my service is supposed to return data from the other 19 databases, along with a warning message indicating that the data is incomplete.

I would like to write a test to verify that my code properly handles the case where one of the MySQL instances has experienced a hardware failure. The point is that I can't do this as a strict black-box test where I merely issue calls to my service's public API.

[edit] And of course "testing the externalities" doesn't help here. I can test the MySQL instances and verify that they are all running, but that doesn't remove the need for my code to handle the possibility that at some point one of them goes down.

snewman··on Is TDD Dead? (2014)
I think GP is referring to nondeterministic exceptions. For instance, if the service under test depends on some other service, then you may need to test the scenario where the other service is unavailable. The exception is not triggered by a bug, it is triggered by an operational externality.
snewman··on Classic Google Sites shutting down by September 2021
Correct. But the Google tech stack evolves, and so the codebase may now be based on obsolete internal technologies.

(Source: worked at Google 2006 - 2010, was very slightly involved in helping the Jotspot team integrate)

snewman··on One company's plan to build a search engine Google can't beat
Obligatory xkcd:

https://xkcd.com/810/

snewman··on The San Francisco Bay Area shelter-in-place order is being extended through May
> ...risk of death is 0.01% for 18-45 year olds.

Where do you get this figure? Your first link shows 14 deaths per 100,000 in that age range, or 0.014%, but that is for the entire population, not just people who have had the virus. The same data set reports 1705 cases in that age range. 14 deaths out of 1705 cases is an 0.82% fatality rate.

Of course, that 0.82% figure, reflecting only confirmed cases, is inflated. But conversely, some of those 1705 afflicted 18-45 year olds may still succumb to the virus. The true IFR in this age range in this region _might_ be closer to 0.1% than 0.82%. But 0.01% is just wrong.

snewman··on Covid-19 at a homeless shelter in Boston: Implications for universal testing
Agreed generally, but my understanding is that testing people in the hospital does have value. Just for one example, if you're negative, then you can be placed in a non-Covid wing (otherwise you're liable to catch the coronavirus on top of whatever flu or whatever you actually have), staff don't need to use precious PPE when treating you, etc.
snewman··on Build versus Buy
Thanks for reaching out. It really depends on what you're looking for, and I don't want to hijack this thread with a long discussion, so feel free to reach out at https://scalyr.com/contact. If you're focused on the power of the query language, then Splunk is the undisputed leader, but we are relatively strong as well; see https://app.scalyr.com/help/power-queries. This iteration of our query language was launched last year and was a lot of fun to build -- the team allowed me to write a fair amount of the code. :-)

You can find a more general overview at https://scalyr.com/product.

snewman··on Build versus Buy
> Their profit margin is usually in their efficiency in doing it better than you

This is a very nice way of framing the question.

I think there may be at least two scenarios to consider. For some products, cost is primarily driven by R&D; for others, cost of operating the service (COGS) dominates. Of course it's a continuum, but I suspect there are more services near the ends than the middle.

For an R&D-dominated service, if your needs are nontrivial and there is an off-the-shelf product that is a decent fit, you probably want to go off-the-shelf. A commercial provider can amortize the R&D over a large customer base.

For a COGS-dominated service, the commercial provider may still be more efficient but it is less of a slam dunk. Log management (e.g. Splunk) involves a substantial operational component, because you're dealing with large volumes of data.

Disclaimer: I am the founder of Scalyr, a Splunk competitor. Early on we realized that, even though log management is COGS-heavy, we could achieve huge economies of scale, because query workloads are highly bursty. By carefully managing a central pool of resources shared by many clients, we're able to run much more efficiently than a single-tenant homegrown solution [1]. This is one of the key points that we highlight when having build vs. buy discussions with potential customers.

[1] https://www.scalyr.com/blog/searching-1tb-sec-systems-engine...

snewman··on The Doctor Who Helped Defeat Smallpox Explains What's Coming
Fivethirtyeight has been surveying epidemiologists:

https://fivethirtyeight.com/features/infectious-disease-expe...

Responding on March 16 and 17 to the question, "how many cases will the US report by March 29", their median prediction was 19,000. As of this moment, early on the 21st, that figure has ALREADY been exceeded (per Worldometer). Based on current growth rates, it appears virtually certain that the actual figure on the 29th will exceed the "best-guess" prediction of every single expert surveyed, and the "high-end" prediction of all but one or two. They've completely whiffed a prediction just a few days out.

This is a novel (no pun intended) situation, even for epidemiologists. To understand it, critical thinking skills are at least as important as subject matter expertise. My read is that the Medium article represents some of the best critical thinking on the subject so far.

snewman··on The Doctor Who Helped Defeat Smallpox Explains What's Coming
This site shows the number of tests performed in each state in the US:

https://covidtracking.com/data/

snewman··on State projections for Covid-19
Try reading https://medium.com/@tomaspueyo/coronavirus-the-hammer-and-th....
snewman··on State projections for Covid-19
Certainly: locking down the populace and the economy, without any plans to take advantage of the resulting respite, is unacceptable.

Giving up and attempting to resume normal activity is also unacceptable, full stop.

The best/latest explanation I've seen is https://medium.com/@tomaspueyo/coronavirus-the-hammer-and-th.... Please read it (everyone, not just parent) if you haven't already.

Then if you're frustrated that your political leaders aren't moving to make best use of your sacrifice... let them know!

snewman··on The hard part of the economics of Covid-19
I am not sure I agree with the thrust of this article. The gist seems to be: if we do a sufficiently good job with containment measures (e.g. social distancing), we might succeed in limiting short-term infections, but we will have to remain in this mode for years (with ruinous effects on the economy). The offered alternative is to acknowledge that a significant fraction of the population will be infected eventually, and so we should scale up hospital capacity to accommodate that.

This doesn't seem like a very good alternative. Even with adequate hospital care, the true fatality rate seems to be in the neighborhood of 0.5% to 1%, which would be quite harsh if allowed to spread throughout the population.

I am hoping that improvements in treatment can make the difference. A vaccine may not be available for quite some time, but drugs that reduce the fatality rate might be ready sooner.

Of course the actual course of action must include some mix of all-of-the-above: containment, new hospitals, new treatments.

EDIT: as voidmain notes, we might also hope to quickly reduce the number of infections to the point where we can contain them with testing and contact tracing, rather than blanket shutdowns.

snewman··on Italy and South Korea virus outbreaks reveal disparity in deaths and tactics
It doesn't change the actual odds, it changes the perceived / measured odds.

Imagine 100 people contract the virus, 10 develop serious symptoms, and one dies.

In country A, with widespread testing, 40 of the 100 are identified. The visible statistics are 40 cases, one death, death rate of 2.5%.

In country B, with poor testing, only the 10 with serious symptoms are identified. The visible statistics are 10 cases, one death, death rate of 10%.

Again, this is about the reported statistics, not the underlying truth of the disease.

snewman··on Soli
Fair point.
snewman··on Soli
As predicted in the Hitchhiker's Guide to the Galaxy: "...an electric pencil flew across the cabin and through the radio's on/off-sensitive airspace."
snewman··on Inflated Bond Ratings Helped Spur the Financial Crisis. They’re Back
I agree that "you can expect the value of stocks in general to go up over time in proportion to the growth of the global economy", but this does not contradict "There's no point in trying to game or predict [the market]". Parent is not saying to avoid the stock market. Parent is saying you should not try to outperform the market by making targeted stock picks or getting in and out of the market at targeted times.
snewman··on An update on Sunday’s service disruption
Replying to my own comment:

As many have pointed out, this was not actually the postmortem, just an "update". I still find it pretty weak. There has been plenty of time to assemble basic details, such as a rough timeline. Yes they are busy with the actual response and cleanup, but this is a big professional team. The update feels less like "we're on it, here's what we have so far, more to come", and more like a bland PR minimization exercise.

I'll note that they've found time to determine that "For most Google users there was little or no visible change to their services", "YouTube measured a 10% drop in global views during the incident", and "approximately 1% of active Gmail users had problems", and yet they don't mention the time at which the incident was fully resolved or even when it started! Did the impact last for a few minutes, an hour, or multiple hours? Reading this, I have no idea. But I do learn that "the Google teams were keenly aware that every minute which passed represented another minute of user impact", they "brought on additional help to parallelize restoration efforts", "networking systems correctly triaged the traffic overload", and "low-bandwidth services like Google Search recorded only a short-lived increase in latency". In other words, this update on what seems to have been a very major incident consists mostly of vague, positive statements. It does say "we take it very seriously", but it doesn't make me believe it.

(I would add that I worked at Google from 2006 to 2010, and based on that experience I'm sure they are taking this very seriously and that there will be an excellent internal postmortem. But man, reading this sure makes it hard to remember that.)

snewman··on An update on Sunday’s service disruption
I've seen much more detail in other postmortems from major cloud providers. (AWS and Azure definitely, and I think Google as well.)
snewman··on An update on Sunday’s service disruption
This is a surprisingly vague postmortem. No timeline, no specific identification of affected regions. And no explanation of why a configuration change that was (apparently) made with a single command required so much effort to undo, or why repair efforts were hampered when (again, apparently) the network was successfully prioritizing high-priority traffic. Even for a public postmortem, this seems pretty weak.
← PreviousPage 7 of 15Next →