github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/colossalai/nn/layer
History
アマデウス b8899e0905
[TP] allow layernorm without bias (#750) 		2022-04-14 11:43:56 +08:00
..
colossalai_layer [TP] allow layernorm without bias (#750) 2022-04-14 11:43:56 +08:00
moe [zero] improve adaptability for not-shard parameters (#708) 2022-04-11 13:38:51 +08:00
parallel_1d [TP] allow layernorm without bias (#750) 2022-04-14 11:43:56 +08:00
parallel_2d [TP] allow layernorm without bias (#750) 2022-04-14 11:43:56 +08:00
parallel_2p5d [TP] allow layernorm without bias (#750) 2022-04-14 11:43:56 +08:00
parallel_3d [TP] allow layernorm without bias (#750) 2022-04-14 11:43:56 +08:00
parallel_sequence Refactored docstring to google style 2022-03-29 17:17:47 +08:00
utils Refactored docstring to google style 2022-03-29 17:17:47 +08:00
vanilla [TP] allow layernorm without bias (#750) 2022-04-14 11:43:56 +08:00
wrapper Refactored docstring to google style 2022-03-29 17:17:47 +08:00
__init__.py [MOE] changed parallelmode to dist process group (#460) 2022-03-19 13:46:29 +08:00
base_layer.py [model checkpoint] reworked unified layers for ease of save/load states (#593) 2022-04-01 16:49:56 +08:00