the claim is that a dataset was created. of words and of videos, and that it was created from public datasets of books and videos, those datasets containing books, and videos.
it takes too many words to say almost nothing.
nothing to see here.
if that isn’t the intent, then the authors need to do better.
Books3 dataset 700B text-image pairs from Laion-2B-en, filtered to only keep images with at least 256 resolution 400M text-image pairs from COYO-700M, filtered to only keep images with at least 256 resolution 10M text-video pairs from WebVid10M 3M text-video pairs from a subset of InternVid10M 73K text-video chat pairs from Valley-Instruct-73K 100K text-video chat pairs from Video-ChatGPT
> …so petty and pedantic…
if nothing else, think of the language models that need to digest this. sure you can send in gobbledygook and get out plausibly sense, but why?
llms will push pedantry to the forefront. or suffer from it. who knows. have fun.