Hacker News Reader

Have you come across any specific details on their input datasets? I’ve been assuming CommonCrawl and Pile but if you have anything specific it would be very interesting what else was used.

View on HN

All the major LLM vendors are vague on datasets because it's quite certainly copyrighted text, (Remember when Google was scanning all the world's books a decade ago?) and they don't want to give the inevitable lawsuits a jump start.

You can just ask ChatGPT what data it was trained on.

> The news groups' concerns arose when the computational journalist Francesco Marconi posted a tweet last week saying their work was being used to train ChatGPT. Marconi said he asked the chatbot for a list of news sources it was trained on and received a response naming 20 outlets including the WSJ, New York Times, Bloomberg, Associated Press, Reuters, CNN and TechCrunch.

https://www.bloomberg.com/news/articles/2023-02-17/openai-is...

Can ChatGPT be trusted on these kind of matters, though? If doesn't really know how not to know.

Would ChatGPT snitch on ChatGPT

Wouldn't ChatGPT name a source even if it did not use that source or if the claim could not be sourced?

>Remember when Google was scanning all the world's books a decade ago?

Yes, and I remember that they won that lawsuit.

https://www.google.com/amp/s/blog.google/products/search/ove...

Reply on news.ycombinator.com