Large-capacity flash drives are very cheap; and you can write the same data (e.g. archive files) many times to the same drive to guard against some filesystem or file-level corruption.

There are also tools like par2(1) that can create parity recovery data for files; you could write those many times too.

My online backup solution that backs up the root filesystem for all of my machines generates a rolling tarball of that and then creates par2 recovery data for that tarball at 10% redundancy, and keeps 30 days of tarballs in addition to the current snapshot of the filesystem itself. This is because I store them on high-capacity spinning rust drives, which do have a small but non-zero data error rate.

Additionally, forensic tools like photorec(1) can recover these files even from severely damaged filesystems.

Then the only things you need to worry about are "device doesn't enumerate at all when I plug it in" and such. I'm sure you can have 2 devices side-by-side to mitigate that.

This happens. I've had SDCards sitting in devices long enough unpowered that they required a format when spun back up.