ColossalAI/colossalai/nn/layer
superhao1995 f660152c73 [NFC] polish colossalai/nn/layer/parallel_3d/_operation.py code style (#1258)
Co-authored-by: Research <research@soccf-snr3-017.comp.nus.edu.sg>
2022-07-13 12:08:21 +08:00
..
colossalai_layer [TP] allow layernorm without bias (#750) 2022-04-14 11:43:56 +08:00
moe [gemini] add GeminiMemoryManger (#832) 2022-04-24 13:08:48 +08:00
parallel_1d [Tensor] 1d row embedding (#1075) 2022-06-08 12:04:59 +08:00
parallel_2d [NFC] polish colossalai/nn/layer/parallel_2d/layers.py code style (#976) 2022-05-17 10:25:06 +08:00
parallel_2p5d [NFC] polish colossalai/nn/layer/parallel_2p5d/layers.py code style (#972) 2022-05-17 10:25:06 +08:00
parallel_3d [NFC] polish colossalai/nn/layer/parallel_3d/_operation.py code style (#1258) 2022-07-13 12:08:21 +08:00
parallel_sequence Refactored docstring to google style 2022-03-29 17:17:47 +08:00
utils [NFC] polish colossalai/nn/layer/utils/common.py code style (#983) 2022-05-17 10:25:06 +08:00
vanilla [TP] allow layernorm without bias (#750) 2022-04-14 11:43:56 +08:00
wrapper [pipeline] refactor the pipeline module (#1087) 2022-06-10 11:27:38 +08:00
__init__.py
base_layer.py [model checkpoint] reworked unified layers for ease of save/load states (#593) 2022-04-01 16:49:56 +08:00