It's part of a series of blog posts that talks explicitly about crawling. There are indeed other links that do better explaining advanced extraction techniques.
Extraction => https://www.zenrows.com/blog/mastering-web-scraping-in-pytho...
Avoid blocking => https://www.zenrows.com/blog/stealth-web-scraping-in-python-...