ColossalAI/colossalai/nn/layer
ver217 58580b50fe
Revert "[NFC] Hotfix/format (#984)" (#986)
This reverts commit 0772828fba.
2022-05-17 10:23:38 +08:00
..
colossalai_layer [TP] allow layernorm without bias (#750) 2022-04-14 11:43:56 +08:00
moe [gemini] add GeminiMemoryManger (#832) 2022-04-24 13:08:48 +08:00
parallel_1d [TP] allow layernorm without bias (#750) 2022-04-14 11:43:56 +08:00
parallel_2d Revert "[NFC] Hotfix/format (#984)" (#986) 2022-05-17 10:23:38 +08:00
parallel_2p5d Revert "[NFC] Hotfix/format (#984)" (#986) 2022-05-17 10:23:38 +08:00
parallel_3d Revert "[NFC] Hotfix/format (#984)" (#986) 2022-05-17 10:23:38 +08:00
parallel_sequence Refactored docstring to google style 2022-03-29 17:17:47 +08:00
utils Revert "[NFC] Hotfix/format (#984)" (#986) 2022-05-17 10:23:38 +08:00
vanilla [TP] allow layernorm without bias (#750) 2022-04-14 11:43:56 +08:00
wrapper Refactored docstring to google style 2022-03-29 17:17:47 +08:00
__init__.py [MOE] changed parallelmode to dist process group (#460) 2022-03-19 13:46:29 +08:00
base_layer.py [model checkpoint] reworked unified layers for ease of save/load states (#593) 2022-04-01 16:49:56 +08:00