Frank Lee ddcf58cacf Revert "[sync] sync feature/shardformer with develop"		2023-06-09 09:41:27 +08:00
..
colossalai_layer	fixed using zero with tp cannot access weight correctly	2023-02-28 10:52:30 +08:00
moe	[doc] Fix typo under colossalai and doc(#3618)	2023-04-26 11:38:43 +08:00
parallel_1d	Revert "[sync] sync feature/shardformer with develop"	2023-06-09 09:41:27 +08:00
parallel_2d	[utils] refactor parallel layers checkpoint and bcast model on loading checkpoint (#1548)	2022-09-06 20:18:35 +08:00
parallel_2p5d	[utils] refactor parallel layers checkpoint and bcast model on loading checkpoint (#1548)	2022-09-06 20:18:35 +08:00
parallel_3d	improved allgather & reducescatter for 3d	2023-01-03 17:46:08 +08:00
parallel_sequence	[nfc] fix typo colossalai/nn (#3887)	2023-06-05 16:04:27 +08:00
utils	…
vanilla	added skip_bias_add for non-tp linear	2022-11-09 15:41:08 +08:00
wrapper	…
__init__.py	…
base_layer.py	[utils] refactor parallel layers checkpoint and bcast model on loading checkpoint (#1548)	2022-09-06 20:18:35 +08:00