Lzma. I did a simple test, same payload repeated with a gap. Lzma ruled it.
|gap |gzip |bz2 |lzma | |---------|----------|-----|--------| |0 |2.7% |18.9%|*0.9%*| |8 KB |2.4% |17.8%|0.9% | |*40 KB*|*94.4%* |17.7%|0.4% | |1 MB |*104.3%*|19.7%|*0.9%*|
|gap |gzip |bz2 |lzma | |---------|----------|-----|--------| |0 |2.7% |18.9%|*0.9%*| |8 KB |2.4% |17.8%|0.9% | |*40 KB*|*94.4%* |17.7%|0.4% | |1 MB |*104.3%*|19.7%|*0.9%*|
I don’t see zstd in your comparison?
|gap |gzip |bz2 |lzma |
|---------|----------|-----|--------|
|0 |2.7% |18.9%| *0.9%*|
|8 KB |2.4% |17.8%| 0.9% |
|*40 KB* |*94.4%* |17.7%| 0.4% |
|1 MB |*104.3%* |19.7%| *0.9%*|