csilker··on How I protect my Forgejo instance from AI web crawlersThe way is same with cloudflare. Cloudflare has a documentation and manifest.
csilker··on How I protect my Forgejo instance from AI web crawlersCloudflare has a solution to protect routes from crawlers.https://blog.cloudflare.com/introducing-pay-per-crawl/