加速大模型训练的双向交错流水线并行方法
Bidirectional interleaved pipeline parallelism for accelerating large model training
加速大模型训练的双向交错流水线并行方法 |
| 吴厚明,陈岭 |
|
Bidirectional interleaved pipeline parallelism for accelerating large model training |
| Houming WU,Ling CHEN |
| 图 9 流水线并行和流水线-数据并行方法的吞吐率比较 |
| Fig.9 Throughput comparison of pipeline parallelism and pipeline-data parallelism methods |
|
|