Hacker News Reader

We have a requirement of saving 100million data points every 5 mins. What options should we explore for real time system for last 15 days of data and archival system for last 3 years of data?

View on HN

We've had users at that scale at least on the real-time side (e.g., 100M/5min, 500B rows), although requires some care.

Might be easiest to discuss more on Slack (https://slack-login.timescale.com/) or email (mike at timescale) if you're interested.

I don't have any experience with this type of thing, so that sounds like an incredibly large amount of data. What are you doing that requires it? What type of useful queries are you even able to perform over 432 billion records?

300k+ sensors sampling at 1 hertz would get you there.

What do you do with that data? Just store or do some analysis on it (how? With what kind of resources?)?

Reply on news.ycombinator.com