Hacker News Reader

One of my favourite things about Git scraping is that, thanks to CI providers like GitHub Actions which are free for open projects, it costs nothing to run.

https://github.com/simonw/ca-fires-history for example scrapes every 20 minutes and runs on the free GitHub Actions plan.

I've run these on free Travis CI and Circle CI plans in the past as well.

If you want to run a private Git scraper you can pay money to do so, which seems very reasonable to me.

View on HN

Nifty! Do you plan to use those commit history in any way? Is it just for bookkeeping?

I'm hoping someone uses this data for something interesting - it may end up being me!

I ran the same kind of thing against PG&E outage data last year and used it to generate different visualizations: https://simonwillison.net/2019/Oct/10/pge-outages/

really appreciated your PGE stuff last year. I hope we won't need it, but if we do.. I hope you'll do it again this year. :)

Reply on news.ycombinator.com