I noticed something last night while watching the Djokovic US Open quarter-final. It featured an "IBM Insights" segment which claimed to have mined 8 years worth of Majors competitions to generate stats. And one interesting result it was able to produce went something like this: if Djokovic is able to return only 25% of his opponents serves, then in 85% of past matches it has resulted in victory for him. The implication being that such is the strength of his defensive game.

While this is no doubt really interesting, I find I am getting diminishing returns from outputting stats like this from big dumps of past historical data. What I would like to be able to show is a live heat graph style stats tracker, where each point in the match updates my belief net about who is winning, or playing better. Of course, the final outcome may be upended by some fluke occurrence such as a Hail Mary pass in the final seconds which is what makes sports interesting, but nonetheless I think a live tracker would say a lot more than the actual score of the match.

So, I am wondering if anyone has specific resources for real time online data mining? At web scale for high throughput data streams. And I agree with shubmajain above, libraries and repos are preferable to books and academic journals ;)