Top New Best Ask Show Jobs

Ask HN: Best python library for screen scraping/spidering in python 3? | Hacker News Reader

Ask HN: Best python library for screen scraping/spidering in python 3?

2 points·a_lifters_life··4 comments

https://scrapy.org/ is one I use all the time.

How is its performance compared to like selenium? Can you fake useragent?

It's pretty performant. and Yes, you can specify whatever useragent you want.

Scrapy. 100%.

Reply on news.ycombinator.com