降低分布式训练通信的梯度稀疏压缩方法
陈世达,刘强,韩亮

Gradient sparsification compression approach to reducing communication in distributed training
Shi-da CHEN,Qiang LIU,Liang HAN
图 7 各种稀疏方法与经典训练方法在K40C GPU的扩展性对比
Fig.7 Comparison of scalability between various sparsification and classic training approaches on K40C GPU