You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/colossalai/shardformer/layer
Bin Jia 86d22581e4
[shardformer] Add overlap optional for HybridParallelPlugin (#4615)
1 year ago
..
__init__.py [shardformer] fix import 1 year ago
_operation.py [shardformer] Add overlap optional for HybridParallelPlugin (#4615) 1 year ago
dropout.py
embedding.py [shardformer] fix embedding 1 year ago
linear.py [shardformer/fix overlap bug] fix overlap bug, add overlap as an option in shardco… (#4516) 1 year ago
loss.py
normalization.py [shardformer] support inplace sharding (#4251) 1 year ago
parallel_module.py [shardformer] support sharded checkpoint IO for models of HybridParallelPlugin (#4506) 1 year ago
qkv_fused_linear.py [shardformer] Add overlap support for gpt2 (#4535) 1 year ago
utils.py [misc] resolve code factor issues (#4433) 1 year ago