ColossalAI/colossalai/nn/layer
Jiarui Fang 986f8cbaa7
[inference] overlap comm and compute in Linear1D_Row when stream_chunk_num > 1 (#1876)
2022-11-10 17:36:42 +08:00
..
colossalai_layer added skip_bias_add for non-tp linear 2022-11-09 15:41:08 +08:00
moe
parallel_1d [inference] overlap comm and compute in Linear1D_Row when stream_chunk_num > 1 (#1876) 2022-11-10 17:36:42 +08:00
parallel_2d
parallel_2p5d
parallel_3d
parallel_sequence
utils
vanilla added skip_bias_add for non-tp linear 2022-11-09 15:41:08 +08:00
wrapper
__init__.py
base_layer.py