Hacker News Reader

Excellent, thanks!

I'm purposely being careful too. Big backoff on any error, curl's --time-cond from git commit timestamp, etag where possible, etc.

I'm not particularly concerned about an actual DoS'ing issue, more being on the end of one of those stories that pops up every so often("website owner sics lawyers on F12").

View on HN

Oh interesting - I hadn't considered using --time-cond.

I'm always a bit suspicious of If-Modified-Since because I'm never sure which timezones will be in effect - so I tend to use ETags instead, which achieve the same goal without involving any clock time.

I actually wrote a tiny Python CLI tool for doing those, designed to be used in CI: https://pypi.org/project/conditional-get/

Reply on news.ycombinator.com