What you're talking about is failover and fault tolerance, which are greatly improved in 0.8 with the addition of replication.
438 karma · joined January 13, 2009
What you're talking about is failover and fault tolerance, which are greatly improved in 0.8 with the addition of replication.
RabbitMQ developer on the kafka-users list: http://mail-archives.apache.org/mod_mbox/kafka-users/201306....
SO discussion on several queuing systems: http://stackoverflow.com/questions/731233/activemq-or-rabbit...
A few of the major improvements (from https://archive.apache.org/dist/kafka/0.8.0/RELEASE_NOTES.ht...):
* Intra-cluster replication support
* Support multiple data directories
* Many new internal metrics
* Time based log segment rollout
Plus many bug fixes and other improvements.Also, I pretty much have my headphones on all the time, which is not so different from when I worked in a real office.
Just to point out a few corrections: * Solr does have a transaction log. When using soft commits, the tx log is used to recover any volatile writes in the event of a crash * Solr replicates in a similar manner to ES. It no longer does full-index replication as indicated by the article. A write comes in and is routed to the shard leader and replicas. * Solr too has "High Availability built-in" with automatic failover of shards
One fundamental difference the article does not address is the robustness of Solr's cluster management. Solr uses ZooKeeper under the hood which implements the Paxos algorithm to avoid issues like "split-brain syndrome". ElasticSearch has implemented its own distributed coordination and is susceptible to such issues.
Also, thermal curtains (aka, black-out curtains) can help if you have a lot of window surface area.
1. http://blog.radioshack.com/2011/05/19/radioshack-the-diy-com...
Wolfram, et al really thinks they are hot shit.
But if you really want to dig into it, you have to consider all kinds of stuff like bimodal distribution of ratings (controversial items), rater quality/consistency, age or ratings, etc, etc.
It's really not as simple as you'd think!
After figuring them all out a few weeks into the semester, I started writing up some BASIC programs on my TI-86 that would take in student's parameters and spit out solutions. Long story short, I ended up selling answers to some jocks and got caught (I guess the teacher was suspicious when C students were getting these hard problems correct). End result was: made my teacher simultaneously proud/disappointed, earned a few bucks, learned about corruption/greed.
All in all, it was a good learning experience and I don't regret it (though giving away answers for free would have been more altruistic I guess)
Now there are three Apache projects with quite a bit of overlap (distributed columnar/key-value database). Hooray for fragmentation!
Making write speed claims when you're not touching the disk is like bragging about how fast you can cat a file to /dev/null.