In the early universe, light could not travel freely, because the ambient temperature was hot enough that the universe was filled with plasma. The end of this period is called "recombination", and the light from that point in time is called the Cosmic Microwave Background.
That light is the earliest light we can observe, but it is not the earliest event to have had casual effects on us, nor is the earliest event we can observe.
In particular, that light was emitted about 370,000 years after the Big Bang, while events within the first second after the Big Bang have had casual effects on us.
So there is an important difference between "light" and "casual" in physics.