> However, some formats are supported out of the box: WebDataset, json-pair, openimage, etc.
Forgive my ignorance, but what is "json-pair"?
Forgive my ignorance, but what is "json-pair"?
It's simpliy about linking metadata from a json to a corresponding image or video file, like pairing data003.png & data003.json to a single, virtual record. Some format use this approach: open-image or laion datasets.