Looking this far into the past is partially about zooming in, and another part about the wavelength of the light. JWST being in infrared means that it can see things further away which have been redshifted so far that they are no longer visible to the human eye. As you look farther and farther, objects actually appear bigger, because the universe was smaller and the objects were closer at the time the light from them was emitted. At the end of it is the Cosmic Microwave Background, which is the first light that was able to travel when the universe became transparent enough that photons weren't immediately reabsorbed.