Hacker News Reader

I'm curious if there are opportunities to be a force multiplier here. I see that the Readme says "there's no automated scraper farm" yet. Getting that set up seems crucial. Will jump on the Discord :)

View on HN

The community has been writing scrapers since the beginning, but it's a huge task. We've also written scraper templates, since many counties use the same systems. https://github.com/Police-Data-Accessibility-Project/PDAP-Sc...

Yep, I see that there are a lot of existing scrapers. Getting those up and running automatically on a backend host will make things a lot smoother.

Also, I recommend using Playwright instead of Selenium. I'm in the Discord now and will be hanging out, so looking forward to chatting more about this and contributing.

Thanks for taking a look! DM me on Discord if you'd like to chat about this.

Reply on news.ycombinator.com