You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/colossalai
HELSON 9056677b13
[zero] add chunk size searching algorithm for parameters in different groups (#1436)
2 years ago
..
amp [doc] update rst and docstring (#1351) 2 years ago
builder [NFC] polish colossalai/builder/builder.py code style (#1265) 2 years ago
cli [hotfix] fix some bugs caused by size mismatch. (#1011) 3 years ago
communication [communication] add p2p_v2.py to support communication with List[Any] (#1407) 2 years ago
context [doc] update rst and docstring (#1351) 2 years ago
device [device] add DeviceMesh class to support logical device layout (#1394) 2 years ago
engine [hotfix] fix PipelineSharedModuleGradientHandler (#1314) 2 years ago
fx [fx] modify the calculation of node_size in MetaInfoProp for activation checkpointing usages (#1425) 2 years ago
gemini [zero] add chunk size searching algorithm for parameters in different groups (#1436) 2 years ago
kernel [hotfix] fix CPUAdam kernel nullptr (#1410) 2 years ago
logging [doc] improved docstring in the logging module (#861) 3 years ago
nn hotfix #1434 (#1437) 2 years ago
pipeline [pipeline]add customized policy (#1139) 2 years ago
registry Remove duplication registry (#1078) 3 years ago
tensor [tensor] add shape consistency feature to support auto spec transform (#1418) 2 years ago
testing [test] skip tests when not enough GPUs are detected (#1090) 3 years ago
trainer fix issue #1080 (#1071) 3 years ago
utils [hotfix] fix a running error in test_colo_checkpoint.py (#1387) 2 years ago
zero [hotfix] zero optim prevents calling inner optim.zero_grad (#1422) 2 years ago
__init__.py [NFC] polish colossalai/__init__.py code style (#1285) 2 years ago
constants.py fix typo in constants (#1027) 3 years ago
core.py [Tensor] distributed view supports inter-process hybrid parallel (#1169) 2 years ago
global_variables.py [MOE] add unitest for MOE experts layout, gradient handler and kernel (#469) 3 years ago
initialize.py [hotfix] remove potiential circle import (#1307) 2 years ago