You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/tests/test_shardformer/test_layer
Bin Jia e241b74f24
[shardformer] Add overlap support for gpt2 (#4535)
1 year ago
..
test_dist_crossentropy.py
test_dropout.py [shardformer] supported bloom model (#4098) 1 year ago
test_embedding.py [shardformer] support inplace sharding (#4251) 1 year ago
test_gpt2_qkv_fused_linear_1d.py [shardformer] Add overlap support for gpt2 (#4535) 1 year ago
test_layernorm.py [shardformer] support inplace sharding (#4251) 1 year ago
test_linear_1d.py [shardformer/fix overlap bug] fix overlap bug, add overlap as an option in shardco… (#4516) 1 year ago
test_qkv_fused_linear_1d.py [shardformer] support inplace sharding (#4251) 1 year ago
test_vocab_parallel_embedding_1d.py [shardformer] support inplace sharding (#4251) 1 year ago