ColossalAI/colossalai
HELSON 88759e289e
[zero] add ZeroTensorShardStrategy (#793)
2022-04-19 14:32:45 +08:00
..
amp [hotfix] fix memory leak in zero (#781) 2022-04-18 13:57:03 +08:00
builder [NFC] polish colossalai/builder/builder.py code style (#662) 2022-04-06 11:40:59 +08:00
cli [cli] add missing requirement (#805) 2022-04-19 13:56:59 +08:00
communication [util] fixed communication API depth with PyTorch 1.9 (#721) 2022-04-12 09:44:40 +08:00
context [compatibility] used backward-compatible API for global process group (#758) 2022-04-14 17:20:35 +08:00
engine [refactor] moving grad acc logic to engine (#804) 2022-04-19 14:03:21 +08:00
gemini [refactor] moving grad acc logic to engine (#804) 2022-04-19 14:03:21 +08:00
kernel [zero] add ZeroTensorShardStrategy (#793) 2022-04-19 14:32:45 +08:00
logging Refactored docstring to google style 2022-03-29 17:17:47 +08:00
nn [TP] change the check assert in split batch 2d (#772) 2022-04-16 21:29:57 +08:00
registry Refactored docstring to google style 2022-03-29 17:17:47 +08:00
testing [test] added a decorator for address already in use error with backward compatibility (#760) 2022-04-14 16:48:44 +08:00
trainer [refactor] moving memtracer to gemini (#801) 2022-04-19 10:13:08 +08:00
utils [refactor] moving grad acc logic to engine (#804) 2022-04-19 14:03:21 +08:00
zero [zero] add ZeroTensorShardStrategy (#793) 2022-04-19 14:32:45 +08:00
__init__.py
constants.py
core.py
global_variables.py
initialize.py [refactor] moving grad acc logic to engine (#804) 2022-04-19 14:03:21 +08:00