119 karma · joined March 17, 2010
Everything else was in Piwik's favor, but I'm going to have to use GA because of this one requirement.
1. Lively 2. Google Print
Also, Google Answers preceded Yahoo Answers -- they got that wrong.
Yahoo builds two petabyte PostgreSQL database James Hamilton writes about Yahoo's "over 2 petabyte repository of user click stream and context data with an update rate for 24 billion events per day".
It apparently is built on top of a modified version of PostgreSQL and runs on about 1k machines. In his post, James speculates on the details of the internals. Very interesting.
- Data Mining Book by Jiawei Han et al
- Managing Gigabytes by Witten et al
- Hypertext Mining book by Chakrabarti
Also, since this has potential for FUD and Facebook-bashing, it's in their interest to not publish raw numbers.
Also note mention of hysteresis and Floyd-Steinberg Dithering which are worth reading up on.