ColossalAI/colossalai/nn/layer
Frank Lee 015af592f8 [shardformer] integrated linear 1D with dtensor (#3996)
* [shardformer] integrated linear 1D with dtensor

* polish code
2023-07-04 16:05:01 +08:00
..
colossalai_layer fixed using zero with tp cannot access weight correctly 2023-02-28 10:52:30 +08:00
moe [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
parallel_1d [shardformer] add Dropout layer support different dropout pattern (#3856) 2023-07-04 16:05:01 +08:00
parallel_2d
parallel_2p5d
parallel_3d improved allgather & reducescatter for 3d 2023-01-03 17:46:08 +08:00
parallel_sequence [nfc] fix typo colossalai/nn (#3887) 2023-06-05 16:04:27 +08:00
utils
vanilla
wrapper
__init__.py
base_layer.py [shardformer] integrated linear 1D with dtensor (#3996) 2023-07-04 16:05:01 +08:00