ColossalAI/colossalai
Jiarui Fang 8789850eea
Init Conext supports lazy allocate model memory (#842)
2022-04-22 18:03:35 +08:00
..
amp [hotfix] fix memory leak in zero (#781) 2022-04-18 13:57:03 +08:00
builder [NFC] polish colossalai/builder/builder.py code style (#662) 2022-04-06 11:40:59 +08:00
cli [cli] added check installation cli 2022-04-20 12:13:27 +08:00
communication [util] fixed communication API depth with PyTorch 1.9 (#721) 2022-04-12 09:44:40 +08:00
context [compatibility] used backward-compatible API for global process group (#758) 2022-04-14 17:20:35 +08:00
engine [refactor] moving grad acc logic to engine (#804) 2022-04-19 14:03:21 +08:00
gemini [tensor] reorganize files (#820) 2022-04-21 14:15:48 +08:00
kernel Revert "[zero] add ZeroTensorShardStrategy (#793)" (#806) 2022-04-19 14:40:02 +08:00
logging
nn [TP] change the check assert in split batch 2d (#772) 2022-04-16 21:29:57 +08:00
registry [dependency] removed torchvision (#833) 2022-04-22 15:24:35 +08:00
tensor Init Conext supports lazy allocate model memory (#842) 2022-04-22 18:03:35 +08:00
testing [test] added a decorator for address already in use error with backward compatibility (#760) 2022-04-14 16:48:44 +08:00
trainer [log] local throughput metrics (#811) 2022-04-20 10:05:39 +08:00
utils Init Conext supports lazy allocate model memory (#842) 2022-04-22 18:03:35 +08:00
zero revert zero tensors back (#829) 2022-04-22 12:12:35 +08:00
__init__.py
constants.py
core.py
global_variables.py
initialize.py [gemini] APIs to set cpu memory capacity (#809) 2022-04-19 16:05:22 +08:00