github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
Making large AI models cheaper, faster and more accessible
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
3415 Commits
31 Branches
46 Tags
236 MiB
 
 
 
 
 
Tree: 7a2b08646f
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from '7a2b08646f'
${ noResults }
ColossalAI/colossalai
GuangyaoZhang 7a2b08646f
Remove CohereLayerNorm and use existing layernorm 		5 months ago
..
_C Clean up 6 months ago
_analyzer [test] Fix/fix testcase (#5770) 6 months ago
accelerator
…
amp
…
auto_parallel [misc] refactor launch API and tensor constructor (#5666) 7 months ago
autochunk [hotfix] Fix examples no pad token & auto parallel codegen bug; (#5606) 7 months ago
booster Support 4d parallel + flash attention (#5789) 5 months ago
checkpoint_io [shardformer] upgrade transformers to 4.39.3 (#5815) 5 months ago
cli
…
cluster [Feature] Distributed optimizers: Lamb, Galore, CAME and Adafactor (#5694) 6 months ago
context [Fix]: implement thread-safety singleton to avoid deadlock for very large-scale training scenarios (#5625) 7 months ago
device [Feature] Distributed optimizers: Lamb, Galore, CAME and Adafactor (#5694) 6 months ago
fx [test] Fix/fix testcase (#5770) 6 months ago
inference [shardformer] upgrade transformers to 4.39.3 (#5815) 5 months ago
interface [Feature] Distributed optimizers: Lamb, Galore, CAME and Adafactor (#5694) 6 months ago
kernel [NFC] Fix code factors on inference triton kernels (#5743) 6 months ago
lazy [lazy] fix lazy cls init (#5720) 6 months ago
legacy [sync] Sync feature/colossal-infer with main 6 months ago
logging
…
moe
…
nn [misc] fix dist logger (#5782) 6 months ago
pipeline [LowLevelZero] low level zero support lora (#5153) 7 months ago
quantization [Feature] qlora support (#5586) 7 months ago
shardformer Remove CohereLayerNorm and use existing layernorm 5 months ago
tensor [Feature] Distributed optimizers: Lamb, Galore, CAME and Adafactor (#5694) 6 months ago
testing [misc] Accelerate CI for zero and dist optim (#5758) 6 months ago
utils
…
zero [gemini] quick fix on possible async operation (#5803) 5 months ago
__init__.py
…
initialize.py [misc] refactor launch API and tensor constructor (#5666) 7 months ago