Hacker News Reader

I don't really understand why they compare the Robots.txt file to a suicide note. Could anyone explain this?

ArchiveTeam mostly flashmob archives sites that are going to die an rm -rf / death, or atleast kill their users content.

Like Geocities, Yahoo! Video, Google Video, Friendster