Official CLI Tool for the Internet Archive
archive.org
archive.org
The IA's rate limits are quite aggressive (rightly, I suppose) and so I would like to scan my own text-mirror for the precise point I want and then I can click through to the IA's full wayback machine.
$10/TiB is about what I'd expect for storage drives and perhaps with the right indexing scheme I can spend $10k or less and have a multi-level cache using overlayfs with goofys or some such equivalent.
Me too, first commit was a bit more than 11 years ago.
So this tool is super handy for that. Heck, it's useful even for small collections just because of how convenient it is.
(Obviously curl download piped into "sh" or similar is pretty terrible, but at the end of the day, there's a ton of software out there being installed via trust alone)