Ask HN: Do you run a web scraper? How are you dealing with GDPR splash screens?
An increasing number of sites have cookie consent splash screens. In some cases they are just overlays, but in other cases there's a redirect that physically prevents you from retrieving any content before you click a button.
Are you running a web scraper / bot? Have you noticed a drop in success as a result? Are there known strategies for dealing with this? Does using an appropriate user-agent work?
Conversely, do you run a website that does this, and have you taken into account of non-human user agents?