Hacker News Reader

> This got me wondering why the filesystem itself doesn't run a similar kind of deduplication process in the background.

It's considered an "expensive" configuration that is only good for certain use-cases, though, due to its memory requirements.

Yes true, but that page also covers some recent improvements to de-duplication that might assist.

Really? I haven't looked at this ZFS feature in a few years so I will take a look

EDIT: Is this referring to the "fast" dedup feature?

Yes. It doesn't solve everything, but it looks promising