You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/colossalai/nn/layer
digger yu 1878749753
[nfc] fix typo colossalai/nn (#3887)
1 year ago
..
colossalai_layer fixed using zero with tp cannot access weight correctly 2 years ago
moe [doc] Fix typo under colossalai and doc(#3618) 2 years ago
parallel_1d [doc] Fix typo under colossalai and doc(#3618) 2 years ago
parallel_2d [utils] refactor parallel layers checkpoint and bcast model on loading checkpoint (#1548) 2 years ago
parallel_2p5d [utils] refactor parallel layers checkpoint and bcast model on loading checkpoint (#1548) 2 years ago
parallel_3d improved allgather & reducescatter for 3d 2 years ago
parallel_sequence [nfc] fix typo colossalai/nn (#3887) 1 year ago
utils [NFC] polish colossalai/nn/layer/utils/common.py code style (#983) 3 years ago
vanilla added skip_bias_add for non-tp linear 2 years ago
wrapper [NFC] polish colossalai/nn/layer/wrapper/pipeline_wrapper.py code style (#1303) 2 years ago
__init__.py [MOE] changed parallelmode to dist process group (#460) 3 years ago
base_layer.py [utils] refactor parallel layers checkpoint and bcast model on loading checkpoint (#1548) 2 years ago