Hacker News Reader

Don't accept user-generated content. Failing that, never go down, and never announce that you're shutting down.

Or, if you do, hand over the data in a nicely archivable form, and prevent the need for crawlers.