FoolPlayer 92f6791095 [shardformer] Add layernorm (#4072) ... * add layernorm to bert * add layernorm test * add layernorm test with load state dict * add use_mixedfusedLN in shard config * refactor policy to support fused_layernorm		2023-07-04 16:05:01 +08:00
..
test_dist_crossentropy.py	[shardformer] refactored the shardformer layer structure (#4053)	2023-07-04 16:05:01 +08:00
test_dropout.py	[shardformer] refactored the shardformer layer structure (#4053)	2023-07-04 16:05:01 +08:00
test_embedding.py	[shardformer] support module saving and loading (#4062)	2023-07-04 16:05:01 +08:00
test_layernorm.py	[shardformer] Add layernorm (#4072)	2023-07-04 16:05:01 +08:00
test_linear_1d.py	[shardformer] supported fused qkv checkpoint (#4073)	2023-07-04 16:05:01 +08:00
test_linearconv_1d.py	[shardformer] Add layernorm (#4072)	2023-07-04 16:05:01 +08:00
test_vocab_parallel_embedding_1d.py	[shardformer] support module saving and loading (#4062)	2023-07-04 16:05:01 +08:00