ParentFull threadfalcolas·What's the appropriate user agents to disallow if you want to let search engines in, but not ML training crawlers?View on HN