pkj

From the website:

"Here from HackerNews? This was originally posted several months ago. Check back in two weeks for an updated benchmark including newer versions of Hive, Impala, and Shark."

A really good intro to Raft --> http://www.youtube.com/watch?v=YbZ3zDzDnrw

Very useful if you are into distributed systems and would like to see a practical implementation with clear examples.

I would argue there is more than sufficient interest :) All you have to do is scan the angularjs google groups for ngRepeat issues.

Infact, one of the solutions proposed for ngRepeat issue (with lot of caveats) has 300+ stars no github

https://github.com/Pasvaz/bindonce

Including me, there are lot of folks who would find your solution very useful. You are addressing a fundamental O(n) scaling problem in AngularJS.

The top comment by moskie points out one such chrome extension. Just installed it and works great for collapsing threads.

https://chrome.google.com/webstore/detail/hackernew/lgoghlnd...

>"That plays well to our market development program where 1,200 big company management teams are coming through our office every year -- we ask them what they think about new ideas and they tell us."

How about asking BigCos their top pain points once in a while? That would be a 1200x treasure for current/future entrepreneurs.

>Running an all layer2 network requires devices that have large enough CAM tables to support all connected devices, many vendors newer full line rate cards were coming out with smaller CAM tables, as such layer2 simply wasn't an option in some cases.

Does this imply that mac forwarding tables(on switch) and arp cache(on hosts) need to have entries only for their immediate neighbours ?

Curious to know how much modified the host network stack is. Also, how do you provision a new server with the right IP ? Is this mechanism in L2 ?

>There are many other reasons that layer2 wasn't a good choice for us, and that layer3 makes a lot of sense. I'd be happy to discuss more of these as well.

I am sure people would find that very useful. Thanks for the excellent writeup !

Sure, we are trying through global warming :)

On a serious note, take a look at cumulus networks[1] who claim to solve the hw/sw disaggregation problem. They have a linux OS distro which can run on h/w of multiple vendors ( not the popular ones like cisco/jnpr/hp/brcd etc.. since those are closed platforms).

[1] http://cumulusnetworks.com/product/overview/

I had taken a course designed by him at stanford: object oriented programming from a modeling and simulation perspective. I also have the lecture notes for the follow-up course. It was mentioned that the course was based on his real world experience doing c++ programming in academia and startup that he sold to Cisco. It was very clear from the beginning that the course was radically different from any programming course I had seen. Highly opinionated in almost every page. There was rarely anything that he repeated from any standard c++ books. I enjoyed the course, though only about 5% still remains with me. I have worked in teams using c++ extensively to manage $Billion+ products, and can attest that the course definitely had some value. Also, I had interviewed with a C++ team in Cisco 4K catalyst group and they mentioned they were still building on the c++ platform laid by Cheriton's group ( a decade later).

Talking about any disadvantages, I can say that you need someone of Cheriton's ability to really guide you during the initial build-up of the project. His ideas of having the compiler do a lot of checking to avoid bugs in the code later are really cool. But the learning curve is pretty steep. Newer paradigms (since the course was originally designed) like STL, BOOST, and tips in Effective C++/STL etc can replace some of the concepts he espouses. But he is pretty clear that some of them are really inferior. It might be true for some cases, but I have usually used them in production just fine..

Duplicate (mobile version) of an earlier submission. See the earlier discussion at

https://news.ycombinator.com/item?id=6305671

If you are ok with CentOS/RHEL, there is a scalable way to boot multiple machines simulataneously using ........ bittorrent !

http://www.rocksclusters.org/rocks-doc/papers/two-pager/pape...

Rocks is used at production cluster installations with thousands of servers.

http://www.rocksclusters.org/rocks-register/index.php?sortby...

Similar relative results, except that method 1 is always the fastest and even better than method 6. Ran loop count with large numbers (10 million & 30 million) to reduce measurement noise. Profiling was with cProfile on Core i3 2.53Ghz, 6 GB ram, Python 2.7.3 on Ubuntu 12.04

for 10M loop count, method 1 -> 1.599 s, method 6 -> 1.91 s

for 30M loop count,method 1 -> 4.967 s, method 6 -> 5.871 s

Summary: The KISS s1 += s2 always wins

Just tried it out and it is excellent ! The integration of various aws services is really neat. The help and correction-suggestion are nice too.

Great to hear that this is built on the awesome boto library. Will serve as an useful reference for boto developers.

Absolutely. Very interesting talk. Definitely deserves a submission.

BTW, the person asking the last couple of questions is Ed Bugnion, one of the co-founders of VMWare. He is a faculty now at EPFL.

US Navy did not fire it. From Reuters:

http://www.reuters.com/article/2013/09/03/us-syria-crisis-us...

Nothing wrong. This is standard industry practice. Check out glassdoor salaries for companies in diverse locations.

Thanks for the comprehensive clarification. Yes you are right that the use of revision-id would allow "first change to reach the server wins" for case (i). It would result in a simple and fair outcome. I did not see the mention of revision usage in the parent link. But it makes absolute sense.

Think we agree on case ii). On case iii) I still think that having 1 local and N-1 remote might be useful when we want to prioritize a particular writer over others. Borrowing the sales example from commenter jchrisa, consider a new user sales-head (local rule). He syncs the data uploaded by his sales folks (remote rule) and then goes offline. When he is done editing and comes online, he wants to make sure his delta takes precedence irrespective of any previous changes by sales folks during his being offline. Since he has local rule, his update will just win. Further, he does not want sales guys who were offline and come online after him to overwrite his last update immediately. I am assuming that the sales folks with "remote" rule will see the data with newer server version and accept it.

Trying to wrap my head around this. Seems difficult without clear usecases.

Let's say I have 10 devices d1,d2....d10 making updates to "a" on the server and went offline. a==20 and last update was by d5 before everyone went offline.

When the devices come back up, the fate of "a" depends on the rulesets. Following are 3 possible high-level combinations.

i) All devices have "remote" rule. On reconnection, everyone rollback "a" to 20. They are essentially back to the time before going offline. Even the device which did the last update(d5) before going offline is rolled back too, which seems bit odd. Still simple to reason with..

ii) All devices have "local" rule. On reconnection, the last device to reconnect updates "a". It is then broadcasted to all other devices. Note that it is not the last device to update "a". Rather it is the last to reconnect (Now, even if all of them reconnect at same time, depending on the queueing at server, the one at the tail wins). Not really simple..

iii) Mix of "remote" and "local" Let's say d1 had "local" rule and all others had "remote". On reconnection, d1's "a" will be propagated to everyone. This is irrespective of the order of reconnection (I am assuming that between reconnections "a" is not modified). This is pretty simple and perfectly predictable. Now, if we have more than one "local", we start getting non-deterministic, and at the extreme move to case ii)

If a client app is processing the cust record, how would cust.email look like ? Typically I would assume a single value, but in case of unresolved conflicts will it be a iterator/array ?

What you describe is very close to how hundreds of thousands of grads are hired into Indian software service industry. Aptitude test followed by training and plenty of time to come to speed and be evaluated. It has worked out fine for them. Layoffs are very rare.

Startups are a different story as time to market is crucial and you have almost no slack.

"plenty of talented developers.."

        ^^^^^^^^

From my experience in bay area & india, I never saw shortage of resumes for open positions. Large enough even if you assume people applying to multiple companies. The shortage though was for talented folks meeting the expectations of mgr/co-workers.

"The government of India has said it needs to add 800 new universities, in part to avoid a shortfall of 1.6 million university-educated engineers by the end of the decade."...

That's wildly optimistic. The reality is unemployment rate for indian engineering graduates now ranges from an optimistic 50% upto 80%..

[1] http://www.livemint.com/Industry/HCWB4sLvFBxfIFyNBYtqOP/Degr...

[2] http://articles.economictimes.indiatimes.com/2013-06-18/news...

AppFog was built originally around another PaaS, Cloud Foundry. Wonder how this offering will compare with that. I can understand that there would be more control because of the IaaS nature of the offering. Anything stopping them from doing the same with Cloud Foundry ?

Most companies use a variant of stack ranking. If you agree with the core philosophy that more productivity => better pay, then you need to implement some sort of a differential pay algorithm. Having said that the implementation really sucks. It is not natural and continuous, rather people get pigeonholed into discontinuous buckets.

Let me take a concrete example closely mirroring my experience. There are 4 fixed performance buckets. Top 5%, Next 20%, Next 65%, Bottom 10%. They get hikes of 20%, 8%, 4%, 0% respectively. Again, these are fixed numbers. Let us assume there are 4 people A,B,C,D and out of a hypothetical score of 100, score 95, 90, 87, 85 respectively based on various parameters. You would assume that since D differs in ability with A by 10%, he would get 90% of A's hike. But sorry, due to the stack implementation he gets 0%, while A gets 20% ! Let's say if the scores of A, B, C, D were instead 100, 50, 25, 5, the hikes would have make much more sense.

Summary: Discrete curve of benefits works well only when it closely matches the curve of people productivity. This is rare. So it just ends up being unfair and creates an unhealthy rat race.

Have been a vi user for a long time. For c/c++ it is awesome and good enough. Sublime is fine too. Surprised no one mentioned Source Insight though ( unfortunately only windows ), was used in pretty big projects I was involved in. Speedy with auto-completion, caller/callee functions, beautiful syntax highlighting etc..

For large web programs ( html/js etc), once you use Sublime, no going back to VI. The plugin ecosystem for js fwks are awesome.

>never had to download "random codecs" from "random codec packs"

Second that. I have had videos which couldn't be played on VLC (codecs or missing frames) play nicely with mplayer. Easily the best versatile player, especially if you are conversant with the command line options ( or take a quick look at man page).

I doubt people really know ON/OFF by reading the text. More of a sense of alignment. In India, you don't have text on the switches. Also, it's opposite to the direction of the switches in US (Pressing down is ON). Further, if you have 2-way switches there is no way of labeling them.