Deep Gradient Compression [pdf]

openreview.net

2 pointsstablemap1 comment

In this paper, we find 99.9% of the gradient exchange in distributed SGD is redundant, and propose DGC to greatly reduce the communication bandwidth.

Reply on news.ycombinator.com