The speed of packets in fiber is exactly the one calculate doing the math combining together the speed of light and the refraction coefficient of fiber.
What slowndown everything is reaching an hub, detect the light and trasmute those impulses into bits, decide where to redirect the packet, and re-trasmute the bits into light impulse.
It is not the light domain the one that dominate the speed of packets but is the electronic domain.
Am I wrong?