Hacker News Reader

Parent Full thread

userbinator

The robots.txt you see now is probably the one on the server "parking" the domain, and not that of the original site.

A "site:kuro5hin.org" query shows results, so I'm guessing the original one isn't a block-all.

View on HN

Nothing via the wayback machine... :-(

http://web.archive.org/web/*/http://kuro5hin.org

All that lost content...

IIRC, a (current) robots.txt retroactively will remove public access to the Archive. RIP.

This annoys me to no end. It basically means that you can retroactively censor content by buying a domain that was parked for 10 years and then remove the old content with one little robots.txt. All of this regardless of the wishes of the original creators.

Will it also delete the content?

I remember reading that they don't actually delete anything, even if served DMCA notices --- they just remove access to it, with the justification being that laws may change and one day allow access again. Makes sense for an archive, I guess.

Ah good, so there still is hope :)

>The robots.txt you see now is probably the one on the server "parking" the domain, and not that of the original site.

Still enough for TWBM to kill all its archives. It's ridiculous :(

Reply on news.ycombinator.com