This is an interesting use of the HyperLogLog algorithm. And yay for less RAM overhead.
addthis/stream-lib is pretty awesome, we use it also for its stream summary implementation and has been amazing for identifying things like which partitions are updated or read the most