Hacker News Reader

Comment by jboynyc | Hacker News Reader

Curious: what does "/-/" it their robots.txt[1] do?

    User-agent: *
    Disallow: /-/
    Disallow: /account/

Informs search engines not to index the http://www.quip.com/-/ directory.

OK, cheers. I assumed it must be some kind of regexp because according to the Web Archive (see my comment below) the entire domain is disallowed.

That's just where we put the ajax paths to keep a cleaner URL space

Interesting. However, it seems to block bots entirely: http://web.archive.org/web/*/http://www.quip.com

We just opened up the file at launch... Maybe caching or latency?