Indeed, the trend in corporations is to be actively hostile to web scrapers as well. Programmatic access is not encouraged so they can sell more ads.