ColossalAI/colossalai/utils
YuliangLiu0306 2053e138a2
[context]use meta tensor to init model lazily. (#1187)
* [CLI] add CLI launcher

* Revert "[CLI] add CLI launcher"

This reverts commit df7e6506d4.

* [context]use meta tensor to init model lazily.

* polish

* make module with device kwargs bypass the normal init.

* change unit test to adapt updated context.
2022-06-29 21:02:30 +08:00
..
data_sampler Refactored docstring to google style 2022-03-29 17:17:47 +08:00
model [context]use meta tensor to init model lazily. (#1187) 2022-06-29 21:02:30 +08:00
multi_tensor_apply Refactored docstring to google style 2022-03-29 17:17:47 +08:00
profiler [utils] refactor profiler (#837) 2022-04-24 17:03:59 +08:00
tensor_detector Refactored docstring to google style 2022-03-29 17:17:47 +08:00
__init__.py [refactory] add nn.parallel module (#1068) 2022-06-06 15:34:41 +08:00
activation_checkpoint.py [util] fixed activation checkpointing on torch 1.9 (#719) 2022-04-12 09:35:45 +08:00
checkpointing.py polish checkpoint docstring (#637) 2022-04-02 13:34:33 +08:00
common.py [hotfix]different overflow status lead to communication stuck. (#1175) 2022-06-27 09:53:57 +08:00
cuda.py [refactor] refactor the memory utils (#715) 2022-04-11 16:47:57 +08:00
memory.py [gemini] APIs to set cpu memory capacity (#809) 2022-04-19 16:05:22 +08:00
moe.py Refactored docstring to google style 2022-03-29 17:17:47 +08:00
timer.py Refactored docstring to google style 2022-03-29 17:17:47 +08:00