加速大模型训练的双向交错流水线并行方法

吴厚明,陈岭

Bidirectional interleaved pipeline parallelism for accelerating large model training

Houming WU,Ling CHEN

图 11 超参数研究结果

Fig.11 Hyperparameter study results