Full threadstablemap·In this paper, we find 99.9% of the gradient exchange in distributed SGD is redundant, and propose DGC to greatly reduce the communication bandwidth.View on HN