> You and I have never seen even 100,000 photos in our lives

If someone's 30, that'd only require seeing 10 images a day. For most people that quota is probably fulfilled within a couple of minutes of watching TV or browsing social media, even if the video stream from our eyes otherwise counts as nothing.

We've also had about 4 billion years of evolution, slowly adjusting our genome with an unfathomable amount of data. Gradient descent is blazing fast by comparison.