Hacker News Reader

Since robots.txt is currently ignored by bad actors, why would any alternative be better?

> bad actors

I prefer the term ‘Chad third-party scraper’ [1]

Because Google can start ripping off content in the open with impunity.