SQLite Transparent Compression

github.com

5 pointsedweis2 comments

I used this to index and store a subset of Wikipedia's archive and it works great.

Note: We've crossed paths on another thread (Reddit?).

I have an experiment going (as part of a talk) of how compressed of a sqlite database I can get all of English Wikipedia with full-text search.

So far, the smallest with full articles and titles is 28 GiB.