mirror of https://github.com/hpcaitech/ColossalAI
ae71036cd2
* refactor parallel layer * broadcast rank0 model after load ckpt |
||
---|---|---|
.. | ||
colossalai_layer | ||
moe | ||
parallel_1d | ||
parallel_2d | ||
parallel_2p5d | ||
parallel_3d | ||
parallel_sequence | ||
utils | ||
vanilla | ||
wrapper | ||
__init__.py | ||
base_layer.py |