ColossalAI/colossalai/nn/layer/parallel_2p5d
ver217 ae71036cd2
[utils] refactor parallel layers checkpoint and bcast model on loading checkpoint (#1548)
* refactor parallel layer

* broadcast rank0 model after load ckpt
2022-09-06 20:18:35 +08:00
..
__init__.py [hotfix] Raise messages for indivisible batch sizes with tensor parallelism (#622) 2022-04-02 16:12:04 +08:00
_operation.py [TP] change the check assert in split batch 2d (#772) 2022-04-16 21:29:57 +08:00
_utils.py fix format parallel_2p5d (#357) 2022-03-11 15:50:28 +08:00
layers.py [utils] refactor parallel layers checkpoint and bcast model on loading checkpoint (#1548) 2022-09-06 20:18:35 +08:00