ColossalAI/colossalai
YuliangLiu0306 de2f581d43
[cli] added micro benchmarking for tp (#789)
* [CLI] add CLI launcher

* Revert "[CLI] add CLI launcher"

This reverts commit df7e6506d4.

* [CLI]add cli benchmark feature

* fix CodeFactor issues.

* refactor the module structure.
2022-04-19 12:08:28 +08:00
..
amp [hotfix] fix memory leak in zero (#781) 2022-04-18 13:57:03 +08:00
builder [NFC] polish colossalai/builder/builder.py code style (#662) 2022-04-06 11:40:59 +08:00
cli [cli] added micro benchmarking for tp (#789) 2022-04-19 12:08:28 +08:00
communication [util] fixed communication API depth with PyTorch 1.9 (#721) 2022-04-12 09:44:40 +08:00
context [compatibility] used backward-compatible API for global process group (#758) 2022-04-14 17:20:35 +08:00
engine [refactor] moving memtracer to gemini (#801) 2022-04-19 10:13:08 +08:00
gemini [refactor] moving memtracer to gemini (#801) 2022-04-19 10:13:08 +08:00
kernel [NFC] polish colossalai/kernel/cuda_native/csrc/multi_tensor_adam.cu code style (#667) 2022-04-06 11:40:59 +08:00
logging Refactored docstring to google style 2022-03-29 17:17:47 +08:00
nn [TP] change the check assert in split batch 2d (#772) 2022-04-16 21:29:57 +08:00
registry Refactored docstring to google style 2022-03-29 17:17:47 +08:00
testing [test] added a decorator for address already in use error with backward compatibility (#760) 2022-04-14 16:48:44 +08:00
trainer [refactor] moving memtracer to gemini (#801) 2022-04-19 10:13:08 +08:00
utils [refactor] moving memtracer to gemini (#801) 2022-04-19 10:13:08 +08:00
zero [refactor] moving memtracer to gemini (#801) 2022-04-19 10:13:08 +08:00
__init__.py Develop/experiments (#59) 2021-12-09 15:08:29 +08:00
constants.py fix format constants.py (#358) 2022-03-11 15:50:28 +08:00
core.py [polish] polish singleton and global context (#500) 2022-03-23 18:03:39 +08:00
global_variables.py [MOE] add unitest for MOE experts layout, gradient handler and kernel (#469) 2022-03-21 13:35:04 +08:00
initialize.py fix initialize about zero 2022-04-13 19:10:21 +08:00