Hacker News Reader

Comment by Buetol | Hacker News Reader

Looks like it has already been archived by Archive Team, good job ! http://tracker.archiveteam.org/panoramio/

It's in the process of being archived and is not yet complete.

If you have a spare sever and bandwidth somewhere, you can set up an ArchiveTeam Warrior. They exist as VM images and docker configurations. I've set up a docker instance of their Archive Team's archive warrior (http://www.archiveteam.org/index.php?title=ArchiveTeam_Warri...) and it's currently ploughing its way through the remaining parts of Panoramio which are missing.

No OpenDNS. No ISP DNS that redirects to a search page. Use non-captive DNS servers.

I wonder why they're not running a local full DNS resolver if they're worried about bad DNS servers?

ISPs that block DNS to other servers in the name of "security".

Thanks for mentioning this. I wasn't aware of its existence; I'm now running a Warrior on a VPS, and will likely set up another one at home as well.

It looks like the Panoramio project is returning no work; looking at the dashboard (http://tracker.archiveteam.org/panoramio/), it appears that the archive process is almost complete (still a lot of work out, if I'm reading it right).

The tracker is not always accurate because loading too many jobs can exhaust its RAM. Jobs are loaded in batches, so it may be that there are many more jobs to go.

But on the tracker, it says there's no items left. I've already switched my Warrior to another project because of that.

Thanks for posting this! I've wanted to do something useful and/or helpful with my spare computer + bandwidth, so this is lovely.

It says that they will upload the results to archive.org, which is good news. But is it possible to join a torrent now to make a copy of the dataset?

No.

EDIT: When ArchiveTeam is ingesting to cold storage, there is no torrent available. Once the object(s) are in the Archive, they are retrievable with a torrent.

Looks like there's some WARC files here: https://archive.org/details/archiveteam_panoramio

Corrected my comment.

Reply on news.ycombinator.com