Those images are not really "labeled". They just scraped the alt text. A lot of the recent advances in AI have been by using lower quality large scale web data, instead of hand labeling. The noise will average out. Hand labeled data can be used for finetuning.