Thesis: Partial State in Dataflow-Based Materialized Views

This has already been posted [1], but I do think that this video deserves a better audience.

Jon Gjengset presents his work [2] on materialized views, cache maintenance, and incremental updates, in the context of web databases. His main contributions are around partial state materialization of the hot subset of the data with downstream propagation of the updates and upstream requests to create the missing entries on-demand. These ideas have been implemented with Noria [3], a MySql compatible database designed for mostly-read workloads. The performance measured on lobsters-like workload is really impressive.

[1] https://news.ycombinator.com/item?id=24853783

[2] https://jon.thesquareplanet.com/papers/phd-thesis.pdf

[3] https://github.com/mit-pdos/noria