You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/colossalai
Kirigaya Kazuto 0df5034a36
[pipeline/fix-bug] num_microbatches support any integrate | stable chimera | launch tool for rpc pp framework (#1684)
2 years ago
..
amp
auto_parallel [autoparallel] add unary element wise handler v2 (#1674) 2 years ago
builder [NFC] polish colossalai/builder/__init__.py code style (#1560) 2 years ago
cli
communication [communication] add p2p_v2.py to support communication with List[Any] (#1407) 2 years ago
context [moe] initialize MoE groups by ProcessGroup (#1640) 2 years ago
device [tensor]add 1D device mesh (#1492) 2 years ago
engine [engin/schedule] use p2p_v2 to recontruct pipeline_schedule (#1408) 2 years ago
fx [autoparallel] fix insecure subprocess (#1680) 2 years ago
gemini [feature] A new ZeRO implementation (#1644) 2 years ago
kernel [hotfix] fix CPUAdam kernel nullptr (#1410) 2 years ago
logging
nn [hotfix[ fix colotensor.type() raise NotImplementedError (#1682) 2 years ago
pipeline [pipeline/fix-bug] num_microbatches support any integrate | stable chimera | launch tool for rpc pp framework (#1684) 2 years ago
registry
tensor [autoparallel] update CommSpec (#1667) 2 years ago
testing [NFC] polish colossalai/testing/comparison.py code style. (#1558) 2 years ago
trainer [NFC] polish ./colossalai/trainer/hooks/_lr_scheduler_hook.py code style (#1576) 2 years ago
utils [pipeline/rank_recorder] fix bug when process data before backward | add a tool for multiple ranks debug (#1681) 2 years ago
zero [feature] A new ZeRO implementation (#1644) 2 years ago
__init__.py update version to 0.1.10 (#1676) 2 years ago
_meta_registrations.py [fx/profiler] tuned the calculation of memory estimation (#1619) 2 years ago
constants.py
core.py
global_variables.py
initialize.py