Hacker News Reader

If you're willing to do it, a real browser with playwright is enough.

Playwright isn't sufficient for all cases.

Not for high volumes of data.

It is if you're willing to pay the extra overhead. ex: Google and MS both use rendered pages for advanced scraping.