Hacker News Reader

Currently, we're using Duplicity for our backups, going to Amazon S3.

I've looked a some of the newer options like Bup, Attic, Obnam etc.

However, none of them seem to support S3 as an endpoint, which is a shame. They all seem to need a full-fledged *nix server on the other end.

Does anybody know of any of these new-fangled de-dupe backup apps that works with just S3?

View on HN

Not technically a backup app, but camlistore (http://camlistore.org/) kind of does that:

- you push your files to it

- it optionally encrypts the content and hierarchy

- and stores it pretty much anywhere it can handle (on your disk, on S3, on MongoDB, on GCS, on another instance of camlistore, ...)

S3QL may be a good fit for your needs. It's a FUSE filesystem for S3 that supports encrypted dedup snapshots. You can do backups by rsyncing your current state into the filesystem and snapshotting it. I considered using it for my backups but ended up choosing Attic, so I can't say how well it works in practice.

Unfortunately S3QL uses MAC-then-encrypt[1], which is pretty strongly discouraged[2]. Very nice there's a detailed writeup on the details in the docs though, wish more projects did that.

1: http://www.rath.org/s3ql-docs/impl_details.html (last paragraph) 2: http://www.daemonology.net/blog/2009-06-24-encrypt-then-mac....

Reply on news.ycombinator.com