HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by eimrine | Hacker News Reader
Full thread
eimrine
·
Does he ignore robots.txt file?
View on HN
plondon514
·
> Updates include following robots.txt and identifying user agents so sites can control how ChatGPT interacts with them.
Reply on news.ycombinator.com