Hacker News Reader

There are two to distinguish: "Googlebot" and "Google-Extended".

That seems to be more like a courtesy that Google could stop extending at any point than a requirement grounded in law or legal precedent.

Same goes for OpenAI ignoring these "blocks".