Hacker News Reader

I am quite aware, but I actually built most of the scraping logic a long time ago, before I even knew that playwright was a thing.

I am looking to refactor a lot of this, and switching over to playwright is a high priority, using something like camoufox for scraping, instead of just chromium.

Most of my work on this the past month has been simple additions that are nice to haves

View on HN

I was in a similar boat with my scrapers. Started with Selenium 5-6 years ago and only discovered Playwright 2 years ago. Spend a month or so swapping the two, which was well worth it. Cleaner API, async support.

Luckily, I have some experience with playwright, so swapping shouldn't take me too long.

Currently working on a PR to swap over

Playwright was miles ahead of selenium but what I think is really overlooked is chromedp

Reply on news.ycombinator.com