HNHacker News
TopNewBestAskShowJobs

archivist0

4 karma · joined July 11, 2023

submissionscomments
archivist0··on The Pile: An 800GB dataset of diverse text for language modeling (2020)
> One last thing. The Pile would’ve been far less relevant without the wonderful assistance of The Eye, a group of people who archive all kinds of things. They’ve hosted the datasets for years now. And although it seems strange to say that dataset hosting could make or break The Pile, back then there was nobody else willing to host us. https://the-eye.eu/

I'm afraid to say... the-eye no longer hosts the pile as of today due to legal threats above the likes of DMCA.

Though I believe it's still available via its original torrent and on at.

> https://academictorrents.com/details/0d366035664fdf51cfbe9f7...