github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
Making large AI models cheaper, faster and more accessible
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
3466 Commits
31 Branches
46 Tags
236 MiB
 
 
 
 
 
Tree: 457a0de79f
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from '457a0de79f'
${ noResults }
ColossalAI/colossalai/shardformer/layer
GuangyaoZhang 457a0de79f
shardformer fp8 		4 months ago
..
moe [MoE/ZeRO] Moe refactor with zero refactor (#5821) 5 months ago
__init__.py Remove CohereLayerNorm and use existing layernorm 5 months ago
_operation.py shardformer fp8 4 months ago
attn.py [Inference] Fix flash-attn import and add model test (#5794) 5 months ago
dropout.py [misc] update pre-commit and run all files (#4752) 1 year ago
embedding.py [Inference] Fix bugs and docs for feat/online-server (#5598) 7 months ago
linear.py shardformer fp8 4 months ago
loss.py [Shardformer] Add parallel output for shardformer models(bloom, falcon) (#5702) 6 months ago
normalization.py Remove CohereLayerNorm and use existing layernorm 5 months ago
parallel_module.py [shardformer] refactor embedding resize (#5603) 7 months ago
qkv_fused_linear.py shardformer fp8 4 months ago
utils.py [shardformer] Sequence Parallelism Optimization (#5533) 8 months ago