github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/tests/test_shardformer/test_layer
History
Hongxin Liu d921ce8391 [shardformer] support inplace sharding (#4251) 
* [shardformer] embedding support inplace sharding

* [shardformer] linear support inplace sharding

* [shardformer] layernorm support inplace sharding

* [shardformer] qkv support inplace sharding

* [test] update shardformer layer test

* [shardformer] fix shared param sharding

* [shardformer] fix bert policy

* [shardformer] fix bloom policy

* [shardformer] fix llama policy

* [shardformer] fix opt policy

* [shardformer] fix t5 policy

* [shardformer] fix fused qkv linear

* [shardformer] fix bugs

* force sync

* [test] fix bugs

* [test] fix transformer version
 		2023-08-15 23:25:14 +08:00
..
test_dist_crossentropy.py [shardformer] refactored the shardformer layer structure (#4053) 2023-07-04 16:05:01 +08:00
test_dropout.py [shardformer] supported bloom model (#4098) 2023-07-04 16:05:01 +08:00
test_embedding.py [shardformer] support inplace sharding (#4251) 2023-08-15 23:25:14 +08:00
test_layernorm.py [shardformer] support inplace sharding (#4251) 2023-08-15 23:25:14 +08:00
test_linear_1d.py [shardformer] support inplace sharding (#4251) 2023-08-15 23:25:14 +08:00
test_qkv_fused_linear_1d.py [shardformer] support inplace sharding (#4251) 2023-08-15 23:25:14 +08:00
test_vocab_parallel_embedding_1d.py [shardformer] support inplace sharding (#4251) 2023-08-15 23:25:14 +08:00