You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/colossalai
Kai Lv 0adca5b688
[launch] Support IPv4 host initialization in launch (#5822)
5 months ago
..
_C Clean up 6 months ago
_analyzer [test] Fix/fix testcase (#5770) 6 months ago
accelerator [hotfix] fix typo change MoECheckpintIO to MoECheckpointIO (#5335) 9 months ago
amp
auto_parallel [misc] refactor launch API and tensor constructor (#5666) 7 months ago
autochunk [hotfix] Fix examples no pad token & auto parallel codegen bug; (#5606) 7 months ago
booster Support 4d parallel + flash attention (#5789) 5 months ago
checkpoint_io [shardformer] upgrade transformers to 4.39.3 (#5815) 5 months ago
cli
cluster [Feature] Distributed optimizers: Lamb, Galore, CAME and Adafactor (#5694) 7 months ago
context [Fix]: implement thread-safety singleton to avoid deadlock for very large-scale training scenarios (#5625) 7 months ago
device [Feature] Distributed optimizers: Lamb, Galore, CAME and Adafactor (#5694) 7 months ago
fx [test] Fix/fix testcase (#5770) 6 months ago
inference [shardformer] upgrade transformers to 4.39.3 (#5815) 5 months ago
interface [Feature] Distributed optimizers: Lamb, Galore, CAME and Adafactor (#5694) 7 months ago
kernel [NFC] Fix code factors on inference triton kernels (#5743) 6 months ago
lazy [lazy] fix lazy cls init (#5720) 6 months ago
legacy [sync] Sync feature/colossal-infer with main 6 months ago
logging
moe [hotfix] fix typo change MoECheckpintIO to MoECheckpointIO (#5335) 9 months ago
nn [misc] fix dist logger (#5782) 6 months ago
pipeline [LowLevelZero] low level zero support lora (#5153) 7 months ago
quantization [Feature] qlora support (#5586) 7 months ago
shardformer change 'xxx if xxx else None' to 'xxx or None' 5 months ago
tensor [Feature] Distributed optimizers: Lamb, Galore, CAME and Adafactor (#5694) 7 months ago
testing [misc] Accelerate CI for zero and dist optim (#5758) 6 months ago
utils
zero [gemini] quick fix on possible async operation (#5803) 6 months ago
__init__.py [devops] remove post commit ci (#5566) 8 months ago
initialize.py [launch] Support IPv4 host initialization in launch (#5822) 5 months ago