PG has asked a number of times that people avoid scraping HN, because it thrashes the server.
HN is also running really pretty slow today.
HN is also running really pretty slow today.
Just my luck. As soon as HN took a little while to load for me, I knew that someone would mention it in this thread.
I made hn-api understanding that scraping HN is frowned upon, but also hoping that programmers wouldn't do dumb things with it. As I [said][1], I minimised the number of requests hn-api makes to HN.
In the readme, I say that hn-api is unofficial and unauthorised. I also tell people to be gentle with making requests to HN. Is there some other action I should take? Ideally I'd like to keep my work up, but if pg tells me to take it down, I will.
Great, now I feel all dirty like The Pirate Bay.