降低分布式训练通信的梯度稀疏压缩方法
陈世达,刘强,韩亮

Gradient sparsification compression approach to reducing communication in distributed training
Shi-da CHEN,Qiang LIU,Liang HAN
图 4 DNN分布式训练的计算和通信并行处理
Fig.4 Parallel processing of computing and communication for DNN distributed training