Some very large sites maintain alternate versions of images in chance the browser supports something more efficient than JPEG; that can save about 30% – at the expense of a lot of complexity and extra server side storage. Yet they still do it: It’s still worth it for them.
But nothing beats not loading the image at all!
As a web user, I personally also don’t particularly like it.