How do these guys get the data in order and we dont?
How do these guys get the data in order and we dont?
In contrast, Ethernet link aggregation lets you combine ports that can be arbitrarily far apart -- maybe not even within the same rack (see MC-LAG). Ethernet link aggregation doesn't add any encapsulation or sequencing information to the data flows it manages.
You can imagine an alternate mechanism which added a small header to each packet with sequence numbers; the other end of the aggregation would then have to remove that header after sorting the packets in order..
Probably falls down if one link is 1cm and the other is 100km.
A LAG could be done with different medium/speeds, though perhaps not likely in practice.
802.1AX indeed requires all members of a LAG to use the same speed.
https://www.ieee802.org/3/df/public/23_01/0130/ran_3df_03_23...
That said, I fully expect such an order of magnitude difference to overwhelm the deskew buffer.
LAGs stripe traffic across links at the packet level, whereas QSFP/OSFP lanes do so at the bit level.
Different sized packets on different LAG links will take different amounts of time to transmit. So when striping bits, you effectively have a single ordered queue, whereas when striping packets across links, there are multiple independent queues.