ColossalAI/tests/test_shardformer/test_model
FoolPlayer 92f6791095 [shardformer] Add layernorm (#4072)
* add layernorm to bert

* add layernorm test

* add layernorm test with load state dict

* add use_mixedfusedLN in shard config

* refactor policy to support fused_layernorm
2023-07-04 16:05:01 +08:00
..
__init__.py [shardformer] adapted T5 and LLaMa test to use kit (#4049) 2023-07-04 16:05:01 +08:00
_utils.py [shardformer] Add layernorm (#4072) 2023-07-04 16:05:01 +08:00
test_shard_bert.py support kit use for bert/gpt test (#4055) 2023-07-04 16:05:01 +08:00
test_shard_gpt2.py [shardformer] supported fused qkv checkpoint (#4073) 2023-07-04 16:05:01 +08:00
test_shard_llama.py [shardformer] adapted T5 and LLaMa test to use kit (#4049) 2023-07-04 16:05:01 +08:00
test_shard_t5.py [shardformer] adapted T5 and LLaMa test to use kit (#4049) 2023-07-04 16:05:01 +08:00