JPEG is fascinating and quite complex. Here is a really excellent high level explanation of how it works:

https://www.youtube.com/watch?v=0me3guauqOU