452 karma · joined October 27, 2015
https://qz.com/1166010/air-pollution-even-at-levels-that-mee...
With some basic assumptions on my part including that you can have a delay in writing data to the database (since it's archival and analysis), but you don't want the application to be delayed, putting a fast queue like Kafka or RabbitMQ in place could help. It'll buffer when the database is under load, isolating your application from that.
Offline analysis might also skip the database entirely: columnar data formats (parquet) or log structured merge / sorted string tables (rocksdb) could work very well for archival or offline analysis in MR type environments.
Somebody implemented the algorithm in go based on the paper here: https://github.com/dgryski/go-tsz
A short answer that may work for your question: the bits that are set in RAM are xor values relative to previous values. To provide an answer as to what the value is, a series of read|xor operations are performed.
The naming was always confusing because both companies were based within a mile of each other, never mind the product overlap.
Most don't stay with them for too long, though. It does really take an extra push to advance this. I had a Galaxy Young for two days after I cracked my normal phone's screen. It was kind of hellish.