Hacker News Reader

any serious scraping service these days will fail over to a headless browser when it fetches an asset referencing a js bundle that isn't verifiably a vendor script

I'm aware and will implement SSR soon ;)

It's entirely possible they simply ingest the JS as-is.

Not using JavaScript would also make the crawler fail on squarespace and wix website builders.

The age where the web was usable at all without JavaScript is long gone. No scraper would get much scraping done without JavaScript these days.

You mean by embedding? How can an external site fail on squarespace and wix website builders?

A crawler would fail on all Squarespace and Wix sites if they all require JavaScript.

Found it https://halupedia.com/javascript-requirement-on-squarespace-...