You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/colossalai
botbw dc583aa576
[moe] implement tp
4 months ago
..
_C Clean up 6 months ago
_analyzer [test] Fix/fix testcase (#5770) 6 months ago
accelerator [hotfix] fix typo change MoECheckpintIO to MoECheckpointIO (#5335) 9 months ago
amp
auto_parallel [pre-commit.ci] pre-commit autoupdate (#5572) 5 months ago
autochunk [hotfix] Fix examples no pad token & auto parallel codegen bug; (#5606) 7 months ago
booster [moe] implement tp 4 months ago
checkpoint_io [moe] implement tp 4 months ago
cli [devops] fix extention building (#5427) 9 months ago
cluster [chore] trivial fix 4 months ago
context [Fix]: implement thread-safety singleton to avoid deadlock for very large-scale training scenarios (#5625) 7 months ago
device [Feature] Distributed optimizers: Lamb, Galore, CAME and Adafactor (#5694) 7 months ago
fx [test] Fix/fix testcase (#5770) 6 months ago
inference [Feat] Distrifusion Acceleration Support for Diffusion Inference (#5895) 4 months ago
interface [Feature] Distributed optimizers: Lamb, Galore, CAME and Adafactor (#5694) 7 months ago
kernel [NFC] Fix code factors on inference triton kernels (#5743) 6 months ago
lazy [lazy] fix lazy cls init (#5720) 7 months ago
legacy [Hoxfix] Fix CUDA_DEVICE_MAX_CONNECTIONS for comm overlap 5 months ago
logging
moe [moe] implement tp 4 months ago
nn [misc] fix dist logger (#5782) 6 months ago
pipeline fix object_to_tensor usage when torch>=2.3.0 (#5820) 5 months ago
quantization [quant] fix bitsandbytes version check (#5882) 5 months ago
shardformer [moe] implement tp 4 months ago
tensor [compatibility] support torch 2.2 (#5875) 5 months ago
testing [misc] Accelerate CI for zero and dist optim (#5758) 6 months ago
utils
zero [moe] implement tp 4 months ago
__init__.py [devops] remove post commit ci (#5566) 8 months ago
initialize.py [Hoxfix] Fix CUDA_DEVICE_MAX_CONNECTIONS for comm overlap 5 months ago