Infants do have a "diving reflex" but that is very different from knowing how to swim. If you throw a baby in a pool, the baby will drown and die.

There are undoubtedly similar reflexes that assist fulmars in learning to fly quickly, but that doesn't mean that rapid learning isn't also required.