Hacker News Reader

An automated "backup" service for your website that crawls around and builds a static copy of all the pages it can see. If the site goes does (or if you push a maintenance mode button) it switches to the static site, maybe with a small warning message. You'd probably need to run the DNS or integrate with DNS services to make that easy to implement. The key is it needs to be stupidly easy to set up.

(ping me if you actually start working on this)

View on HN

Very similar, but not exactly: Cloudflare. Takes over your dns routes and will detect when you are down and tries to continue serving.

Yeah, they offer something similar (and in some ways better since it proxies all the requests, it knows what files to save). But it's not quite what I want.

Also there's a lot more you could do. For example, versioning: show me what the site looked like last thursday. For people using crappy or nonexistent CMSes this could be huge.

wget has a mirror option that can do the crawling part for you.

Yep. In my experience it tends to miss a fair bit of stuff, though. I think you'd want to be more aggressive about sniffing out files loaded by javascript or linked from CSS. Wget could probably serve as part of an MVP though.

I don't think the crawler is actually that hard. The killer feature would be the execution and the UX. It should be usable by anyone.

Reply on news.ycombinator.com