I was looking at Seleniumbase recently, and they tell you that you can use Github Actions for web scraping to bypass a lot of blocks (apparently Github Actions use a residential IP-space)
https://seleniumbase.com/new-video-unlimited-free-web-scrapi...