Controlling crawling and indexing now documented on code.google.com | Hacker News Reader