ColossalAI/colossalai/utils
YuliangLiu0306 35ea6e1023
[pipelinable]use pipelinable context to initialize non-pipeline model (#816)
* [CLI] add CLI launcher

* Revert "[CLI] add CLI launcher"

This reverts commit df7e6506d4.

* [pipeline]add module lazy init feature to support large model initization.

* [pipeline]add to_layer_list and partition method to support arbitrary non-pp model

* refactor the module structure

* polish

* [pipelinable]add unit test for pipelinable

* polish

* polish

* Fix CodeFactor issues.
2022-04-24 13:03:12 +08:00
..
data_sampler Refactored docstring to google style 2022-03-29 17:17:47 +08:00
model [pipelinable]use pipelinable context to initialize non-pipeline model (#816) 2022-04-24 13:03:12 +08:00
multi_tensor_apply Refactored docstring to google style 2022-03-29 17:17:47 +08:00
profiler polish utils docstring (#620) 2022-04-01 16:36:47 +08:00
tensor_detector Refactored docstring to google style 2022-03-29 17:17:47 +08:00
__init__.py Init Conext supports lazy allocate model memory (#842) 2022-04-22 18:03:35 +08:00
activation_checkpoint.py [util] fixed activation checkpointing on torch 1.9 (#719) 2022-04-12 09:35:45 +08:00
checkpointing.py polish checkpoint docstring (#637) 2022-04-02 13:34:33 +08:00
common.py [zero] refactor memstats collector (#706) 2022-04-11 10:46:08 +08:00
cuda.py [refactor] refactor the memory utils (#715) 2022-04-11 16:47:57 +08:00
memory.py [gemini] APIs to set cpu memory capacity (#809) 2022-04-19 16:05:22 +08:00
moe.py Refactored docstring to google style 2022-03-29 17:17:47 +08:00
timer.py Refactored docstring to google style 2022-03-29 17:17:47 +08:00