Making large AI models cheaper, faster and more accessible
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
YuliangLiu0306 de2f581d43
[cli] added micro benchmarking for tp (#789)
3 years ago
..
amp [hotfix] fix memory leak in zero (#781) 3 years ago
builder
cli [cli] added micro benchmarking for tp (#789) 3 years ago
communication [util] fixed communication API depth with PyTorch 1.9 (#721) 3 years ago
context [compatibility] used backward-compatible API for global process group (#758) 3 years ago
engine [refactor] moving memtracer to gemini (#801) 3 years ago
gemini [refactor] moving memtracer to gemini (#801) 3 years ago
kernel [NFC] polish colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu code style (#667) 3 years ago
logging
nn [TP] change the check assert in split batch 2d (#772) 3 years ago
registry
testing [test] added a decorator for address already in use error with backward compatibility (#760) 3 years ago
trainer [refactor] moving memtracer to gemini (#801) 3 years ago
utils [refactor] moving memtracer to gemini (#801) 3 years ago
zero [refactor] moving memtracer to gemini (#801) 3 years ago
__init__.py
constants.py
core.py
global_variables.py
initialize.py fix initialize about zero 3 years ago