Most of those chips have zero impact on latency, and many aren't even involved in the actual packet flow.