Hacker News Reader

How would you cope with losing all you data once a week?

"once a week" was maybe a too extreme example. For my case specifically: lost data can be recomputed. Basically a bunch of compiler outputs, indexes and analysis results on the input files, typically an order of magnitude larger than the original files themselves.

Any files that are important would go to a separate, more reliable filesystem (or uploaded elsewhere).

On top of other suggestions I've seen you get already, raid0 might be worth looking at. That has some good speed vs reliability tradeoffs (in the direction you want).

Some video production workflows are run on 4xraid0 just for the speed - it fails rarely enough and intermediate output is just re-created.

Can confirm. When I can't work off my internal MacBook storage, my working drive is a RAID0 NVME array over Thunderbolt. Jobs setup in Carbon Copy Cloner make incremental hourly backups to a NAS on site as well as a locally-attached RAID6 HDD array.

If the stripe dies, worst case is I lose up to one hour of work, plus let's say another hour copying assets back to a rebuilt stripe.

There are so many MASSIVE files created in intermediate stages of audiovisual [post] production.

Reply on news.ycombinator.com