ColossalAI/tests/test_shardformer
FoolPlayer 92f6791095 [shardformer] Add layernorm (#4072)
* add layernorm to bert

* add layernorm test

* add layernorm test with load state dict

* add use_mixedfusedLN in shard config

* refactor policy to support fused_layernorm
2023-07-04 16:05:01 +08:00
..
test_layer [shardformer] Add layernorm (#4072) 2023-07-04 16:05:01 +08:00
test_model [shardformer] Add layernorm (#4072) 2023-07-04 16:05:01 +08:00
__init__.py [shardformer] adapted T5 and LLaMa test to use kit (#4049) 2023-07-04 16:05:01 +08:00