Hacker News Reader

Why would automated web crawlers not throw the best de-Glazing techniques at their dataset before model training?

On the off chance that a single digit percentage of the dataset is glazed, they would probably detect and exclude, as that is easier.

The technical equivalent of a decorative rope around a painting in a museum to stop theft.

Because it increases the cost.

Compared to training a model on few thousand or more GPU-hours? Probably merit a footnote, at best.

Just for context LAOIN's largest dataset is 5.8 Billion images

And you'd be spending that compute time for what will be a tiny, tiny,portion of that