Gotcha - it's times like that that I go with an old-fashioned raw HTTP request and parse it with a DOM parsing engine. Sometimes the "web-facing API" (so-to-speak) is better than the official API.
Super cool project!
Super cool project!
In the meantime, if you scrape the HTML, please respect https://news.ycombinator.com/robots.txt and don't do it more than once per 30 seconds. HN's app server runs on a single core, so we don't have a lot of performance to spare! This is in the works to change as well.
That's interesting. Is there any more information about HN's tech stack? I know it's built on top of the Lisp dialect Arc, but I wonder about the server specs and would be happy to be pointed at some resource.
Although I experienced HN being down, I guess the overall uptime and availability is pretty decent. Keep up the good work!
Number of requests is closer to 5M per day now.