Druid – Distributed, real-time, analytical data store

It's used by Metamarkets in production (http://metamarkets.com/); I've seen talks about it at Strata and they're getting really impressive query times on terascale problems.

Shameless plug: if you're interested in fast in-memory analytics and more of the PyData bent, I'm building a system with some similarities to Druid at my company (http://www.datapad.io/) but more focused on optimizing single-node performance (i.e. minimizing EC2 expenses) on medium data (single columns of tables typically fit in memory) than high scalability / real time ingest.

Netflix also uses Druid: http://www.slideshare.net/g9yuayon/netflix-druidstrata2013

It seems like it's part of Netflix's data pipeline, Suro[1].

[1]:http://techblog.netflix.com/2013/12/announcing-suro-backbone...

Take a look at this page: http://druid.io/druid.html#whois

To begin with, it's a column store, which has all kinds of cool implications for data that repeats itself a lot, such as analytics.

Druid was actually built to answer arbitrary questions that could not be answered with pre-aggregated data (because it can become computationally intractable), but still needed to be answered fast enough to power interactive dashboards. At Metamarkets, almost all queries are user driven through our interface. Currently Druid is indeed tailored for time-based event data, but it can shard on more than just time. Disclaimer: I am a Druid comitter and work at Metamarkets.