There was a really good presentation on this a couple of weeks back in Austin. I think it is recorded here: http://engineering.indeed.com/blog/2013/05/indeedeng-data-dr...