HNHacker News
TopNewBestAskShowJobs

pilimi_anna

1,088 karma · joined July 1, 2022

submissionscomments
pilimi_anna··on Anna's Archive: An Update from the Team
Search settings => Display => List (compact)
pilimi_anna··on Show HN: A free, privacy preserving, archive of public Discord servers
Yes, we'd happily host and torrent this.
pilimi_anna··on Meta torrented & seeded 81.7 TB dataset containing copyrighted data
We're grateful to Meta for helping seed and backup our torrents. The more copies the better. Thank you Meta, for helping preserve humanity's legacy! :)
pilimi_anna··on Anna’s Archive approaching 1 petabyte
Anna here. In some sense copyright is appearing to be beside the point, but for the exact same reason copyright holders are becoming more defensive, and trying to expand the scope of copyright. That's one of the reasons why this is such a critical window for preservation!
pilimi_anna··on You can help Anna's Archive by seeding torrents
We'd welcome a Merge Request on our Gitlab for a Captcha implementation that is as good as Cloudflare but can be done without any external dependencies. If anyone cares enough to make that, we'll merge it!
pilimi_anna··on You can help Anna's Archive by seeding torrents
Anna here. Thanks for the broadcast.

We're soon releasing another few hundred TB of completely unique materials (mostly books, also lots of magazines), so help with preserving all of this is sorely needed.

Much, much thanks to everyone who has contributed in one way or another already!

pilimi_anna··on You can help Anna's Archive by seeding torrents
Anna here.

Libgen still uses torrents primarily for preservation. It also hosts on IPFS but that is more for access, and there are very few IPFS seeders.

We tried IPFS for a bit but found it not stable and usable enough for preservation purposes. We're closely watching IPFS development and hope that it will get there, since it would be wonderful to merge the preservation and access use cases in one system.

pilimi_anna··on Key Defendant in Anna's Archive Lawsuit Denies Any Involvement with the Site
Queen
pilimi_anna··on Billion file filesystem
Since the file is sorted you can binary-search it: https://annas-software.org/AnnaArchivist/annas-archive/-/blo...
pilimi_anna··on Lawsuit accuses Anna's Archive of hacking WorldCat
Appreciate the concern! We're not making any public statements about this lawsuit but rest assured we're fine.
pilimi_anna··on "Anna's Archive" blocked following publishers' complaint
Thanks everyone for your interest and support. As you can see, it's paramount that these torrents get seeded widely, to preserve this collection.

Part of it is already preserved fairly well, especially the Sci-Hub torrents and many of the Libgen torrents, but there is currently ~150TB with <4 seeders.

Head over to the "/torrents" page if you'd like to help!

pilimi_anna··on Exclusive access for LLM companies to largest Chinese nonfiction book collection
It really is
pilimi_anna··on Exclusive access for LLM companies to largest Chinese nonfiction book collection
Yes please, put us in touch by email. Or feel free to email me yourself and we can set up more secure comms from there. Thanks so much for everything you are doing as well!
pilimi_anna··on Exclusive access for LLM companies to largest Chinese nonfiction book collection
For what it's worth, we also have millions of previously unreleased (in bulk) books in English, mostly non-fiction, that are available for torrent on our website.

High-speed access available for anyone who can do at-scale text extraction, or who can supply us with new collections.

pilimi_anna··on Anna's Archive – LLM Training Data from Shadow Libraries
Thank you!! Really appreciate it.
pilimi_anna··on Anna's Archive – LLM Training Data from Shadow Libraries
Please seed our torrents! If someone could contribute an automated torrent tracker that shows which torrents are most in need of seeding, we'd incredibly appreciate that (all our code is open source).
pilimi_anna··on 1.3B Worldcat scrape and data science mini-competition
Yes.
pilimi_anna··on 1.3B Worldcat scrape and data science mini-competition
What lawyers?
pilimi_anna··on The code for Anna's Archive
Appreciate your kind words. Our secret is that we just type really fast.
pilimi_anna··on Anna’s Archive: Open-source data library
This is great to hear. We've put a decent amount of time into accessibility when building the site. If you have any feedback for us on this, that'd be very helpful!
pilimi_anna··on Anna’s Archive: Open-source data library
Free high-quality metadata
pilimi_anna··on Anna’s Archive: Open-source data library
Thanks. Added to our list of libraries and archives to look at.
pilimi_anna··on Anna’s Archive: Open-source data library
Opsec + open source > gatekeeping
pilimi_anna··on Anna’s Archive: Open-source data library
Anna here. Thanks for the support and feedback in these comments!
pilimi_anna··on Anna’s Archive has backed up the world’s largest comics shadow library
Good question! We did consider that, but the structure of the directories themselves conveyed a ton of information, so ultimately we thought that it was better to keep it like this.
pilimi_anna··on Anna’s Archive has backed up the world’s largest comics shadow library
The torrents are only for hard-core data hoarders. If you want just a few individual files, you can use Anna's Archive.
pilimi_anna··on Anna’s Archive has backed up the world’s largest comics shadow library
Not sure about Windows. On Linux we use https://github.com/mxmlnkn/ratarmount
pilimi_anna··on Anna’s Archive has backed up the world’s largest comics shadow library
Yeah, maybe not the best idea. And pointless, because we intend to release all torrents soon anyway (most are still processing)! Removed this part, thanks for the feedback.
pilimi_anna··on Anna’s Archive has backed up the world’s largest comics shadow library
Author here. Happy to answer questions. We're excited to finally be getting this collection out there!
pilimi_anna··on A search engine for searching books in the Z-Library index on the IPFS network
I believe it is indeed our index. :) Hurray for open source and open data!
Page 1 of 2Next →