You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/colossalai
Jiarui Fang 294a6060d0
[tensor] ZeRO use ColoTensor as the base class. (#828)
3 years ago
..
amp [hotfix] fix memory leak in zero (#781) 3 years ago
builder [NFC] polish colossalai/builder/builder.py code style (#662) 3 years ago
cli [cli] added check installation cli 3 years ago
communication [util] fixed communication API depth with PyTorch 1.9 (#721) 3 years ago
context [compatibility] used backward-compatible API for global process group (#758) 3 years ago
engine [refactor] moving grad acc logic to engine (#804) 3 years ago
gemini [tensor] reorganize files (#820) 3 years ago
kernel Revert "[zero] add ZeroTensorShardStrategy (#793)" (#806) 3 years ago
logging Refactored docstring to google style 3 years ago
nn [TP] change the check assert in split batch 2d (#772) 3 years ago
registry Refactored docstring to google style 3 years ago
tensor [tensor] ZeRO use ColoTensor as the base class. (#828) 3 years ago
testing [test] added a decorator for address already in use error with backward compatibility (#760) 3 years ago
trainer [log] local throughput metrics (#811) 3 years ago
utils [refactor] moving InsertPostInitMethodToModuleSubClasses to utils. (#824) 3 years ago
zero [tensor] ZeRO use ColoTensor as the base class. (#828) 3 years ago
__init__.py Develop/experiments (#59) 3 years ago
constants.py fix format constants.py (#358) 3 years ago
core.py [polish] polish singleton and global context (#500) 3 years ago
global_variables.py [MOE] add unitest for MOE experts layout, gradient handler and kernel (#469) 3 years ago
initialize.py [gemini] APIs to set cpu memory capacity (#809) 3 years ago