zheng

Most systems I know which require this just do at-least once on the sending side and dedupe on the receiving side. If you build this into your framework, to applications you have exactly-once barring unbounded partitions and the like.

Not sure why this is being downvoted, it's actually a good question. If all of your VM's are idle, you would want your host CPU to idle as well, although my guess is this doesn't happen in things like Xen, VMWare, etc.

Wish I had more upvotes for this. It's surprising how intolerant people become once their opinion becomes the socially acceptable one.

Just wanted to say thank you for hlld/bloomd! At my old company we were looking into uses for them just because the idea and footprint was so cool. We had a couple ideas for hlld and the overhead was so small that we could basically add it to our servers for free.

From the about page

> We figured pretty much everybody knows JavaScript

Even with the implied "everybody" being "everybody that would be interested in joining our site", this is a poor assumption. Not everyone is a ninja-rockstar web developer. In fact, some of the best content on HN comes from people who most likely don't know JS. I get the idea for the site, but the description seems very naive.

(FWIW, I do know JS)

> People are like, ‘Andrew, what could be next?’ And it’s like, ‘Oh. Done.’ We have a mechanical bull. Game-changer. Innovate.

> “We don't call it an after-party. We call it after-hours.”

Waaaay too close to the Poe's Law line, I can't tell if this guy thinks this is for real or if he knows it's ridiculous and is just trying to cash in on demand.

What would be really cool is if this list of genres was open-sourced somewhere. I can see Netflix not wanting that, but it would really save time for however many hackers read this article and decide they want the same data.

They're trying to italicize the word via markdown (which accepts either _ or * ), but HN only supports * . So _really_ should be really

10.0.0.1 or 0x0a000001?

4.2.2.1 or 0x04020201?

Mostly readability and speed of typing, I would think.

A general thanks to aphyr for exploring all of these kinds of issues in distributed datastores at a level where someone without a lot of database knowledge can understand and reason through. If anyone hasn't read his Jepsen series and is interested in these kinds of things, it is well worth a read.

Of course, I wouldn't read it if you store very important data in any of the datastores he talks about, you might be scared to learn how your system actually operates =).

P.S. - The Spanner link is broken, you have some invisible character being added to the end, gets encoded to %E2%80%8E

I think so, following the opt-out link led me to sign up for a G+ account (I'm in the same boat where I have a Google account but no G+).

How exactly is it lying? Microsoft did pay a $100k bounty to a hacker. The HN headline just leaves out extra details (what the bounty was for), but doesn't change the meaning at all. Am I missing something?

Impermium (https://www.impermium.com) - Redwood City, CA

Impermium is a leader in web security, protecting against account compromise, counterfeit registrations, and malicious activity. We generate a real-time risk profile for user activity, enabling sites to take immediate, proactive action against abuse.

On the engineering side, we are primarily a Python shop, although we use the Hadoop ecosystem extensively so there is some Java and we're playing around with Scala. We are a small company of about 15 who are easy-going and super fun to be around.

We're hiring for a couple positions right now, including:

* Senior Data Mining Research Engineer - We need someone who can go from a conversation about stochastic gradient boosting distributed decision trees to a prototype and from a prototype to a fast, scalable, and robust production model.

* Senior Software Engineer - You are an experienced, knowledgable developer who has a breadth of experience and can jump in and ship code on the first day. Experience with big data is a plus.

You can view the actual postings (https://impermium.com/who-we-are/jobs/index). If either of them seem interesting, feel free to send me an email (realglitch@gmail.com).

I think this is huge for CS grads, and I would add to not overlook a blog/SO as it can really showcase your ability to discuss and explain technical topics. I can never write a blog post because every time I try I end up with an outline for a 9-part series explaining everything I've ever learned tangentially related to <topic>, but SO gave me the focus needed to showcase some of my communication abilities. I know that helped me at least get noticed by companies.

This is pretty tech-specific. In many other fields, unpaid internships are seen as a good deal, mostly because their are so few of them and so many applicants. A friend of mine who recently converted an (unpaid) internship to a job in DC worked really hard just to land the internship. At the same time, he was learning the job but in no way provided the same benefit to his employer as a tech intern does.

Previous discussions:

http://news.ycombinator.com/item?id=2904425 (14 comments)

http://news.ycombinator.com/item?id=2598643 (LLVM: 29 comments)

http://news.ycombinator.com/item?id=4211480 (Nginx: 29 comments)

Wouldn't an infestation of wild tigers make it more worth buying? =)

Thanks, while I think the pronunciation is lame and confusing, I grow tired of explaining to people that it is actually correct, they aren't called "trys" or "treys".

I've used gmvault[1] before, and it works pretty well at preserving labels and playing nice with Gmail's specific idioms not common among other IMAP providers.

[1] - http://gmvault.org/

Thanks a lot for the reply, one of my favorite things about HN is getting questions answered by the authors of the tool in question. After reading more, your decision to not post those benchmarks is a smart one. I get where you're coming from with regards to it being hard to make a performance comparison to protobufs, it makes sense now. If/when I need to reach for some serialization I'll certainly try out Cap'n Proto.

I don't have any of these issues, but your description of how you used the 1st gen Kindle is hilarious. Thanks for an unexpected laugh.

The claims on this site are pretty impressive, but I have close to zero knowledge of the history here, so can someone comment on how many grains of salt this should be taken with? Otherwise, this looks pretty cool. Something that beats protobufs in overall speed could be really helpful depending on the application.

TBH, I don't think you're in the wrong here, but expecting someone who has already brought something to your attention to file a "bug report" against your personal website is a bit arrogant.

Impermium (https://www.impermium.com) - Redwood City, CA

Impermium is a leader in web security, protecting against account compromise, counterfeit registrations, and malicious activity. We generate a real-time risk profile for user activity, enabling sites to take immediate, proactive action against abuse.

On the engineering side, we are primarily a Python shop, although we use the Hadoop ecosystem extensively so there is some Java and we're playing around with Scala. We are a small company of about 15 who are easy-going and super fun to be around.

We're hiring for a couple positions right now, including:

* Senior Data Mining Research Engineer - We need someone who can go from a conversation about stochastic gradient boosting distributed decision trees to a prototype and from a prototype to a fast, scalable, and robust production model.

* Senior Software Engineer - You are an experienced, knowledgable developer who has a breadth of experience and can jump in and ship code on the first day. Experience with big data is a plus.

* UX Design Lead - You'll be leading our creative design and our user interaction from conception into production. We're particularly looking for designers who have a vision for big data visualizations.

You can view the actual postings (https://impermium.com/who-we-are/jobs/index). If any of them seem interesting, feel free to send me an email (realglitch@gmail.com).

Their update that data might be kept around until the 30th, but they won't have support after Friday is almost an insult to injury here. I don't understand why they wouldn't just continue to support MyRedis for some reasonable amount of time. So not worth it.

It doesn't look like it still does, as the link is to ".../questions/33470/..."

Yes, how rude that a website operator wants to monetize their content.

I'd agree with your comment about the architecture being compelling. Do you know of any alternatives that are designed with scalability in mind?

This really does appeal to me, but I wish it didn't rely on Cassandra. That's a heavy dependency if you would otherwise have no java in your stack which many mail servers probably wouldn't. It's certainly an interesting departure from flat files or standard databases though.

Note that this post is from 2011, making it much less interesting that he has pictures of a fully assembled Sea Shadow, given that it was scrapped in 2012. Before I saw the date, I was getting ready to put on my tinfoil cap...