Hacker News Reader

I tried to scrape zillow in past (2019) and it was giving me captcha headache. Didn't author faced similar issues?

> As of 2022, Zillow uses PerimeterX for scraping countermeasures. This can be bypassed by using ISP proxies from BrightData.

Why ask without reading the article?

Well, I used luminati( Currently BrightData). And, it was still giving me captcha. In fact, it was giving me more captcha in BrightData. So, I am not sure.

There are services that use humans to solve captchas for a very reasonable price, such as 2Captcha.

Some of the protections are better than others. For example, you may need to use a real browser with Java script support instead of just HTTP requests.

Browserless works well if you enable the stealth functions.

Reply on news.ycombinator.com