ColossalAI/colossalai/nn/layer/colossalai_layer
zbian 61e687831d fixed using zero with tp cannot access weight correctly 2023-02-28 10:52:30 +08:00
..
__init__.py
_utils.py fixed using zero with tp cannot access weight correctly 2023-02-28 10:52:30 +08:00
dropout.py fixed using zero with tp cannot access weight correctly 2023-02-28 10:52:30 +08:00
embedding.py
linear.py added skip_bias_add for non-tp linear 2022-11-09 15:41:08 +08:00
normalization.py [TP] allow layernorm without bias (#750) 2022-04-14 11:43:56 +08:00