Probably link training.

The very fact that it is a tens-gigabit-per-second connection in an environment full of RF noise (we all love our high powered switching power supplies) makes it hard to get a reliable signal instantly. Still shouldn't take longer than a few hundred ms though (worst case).