Jiarui Fang d16671da75 [Tensor] initialize the ColoOptimizer (#898) ... * [Tensor] activation is an attr of ColoTensor * [Tensor] add optimizer * only detach parameters in context * polish code		2022-04-28 15:23:40 +08:00
..
data_sampler	Refactored docstring to google style	2022-03-29 17:17:47 +08:00
model	[Tensor] initialize the ColoOptimizer (#898)	2022-04-28 15:23:40 +08:00
multi_tensor_apply	Refactored docstring to google style	2022-03-29 17:17:47 +08:00
profiler	[utils] refactor profiler (#837)	2022-04-24 17:03:59 +08:00
tensor_detector	Refactored docstring to google style	2022-03-29 17:17:47 +08:00
__init__.py	Init Conext supports lazy allocate model memory (#842)	2022-04-22 18:03:35 +08:00
activation_checkpoint.py	[util] fixed activation checkpointing on torch 1.9 (#719)	2022-04-12 09:35:45 +08:00
checkpointing.py	polish checkpoint docstring (#637)	2022-04-02 13:34:33 +08:00
common.py	[zero] refactor memstats collector (#706)	2022-04-11 10:46:08 +08:00
cuda.py	[refactor] refactor the memory utils (#715)	2022-04-11 16:47:57 +08:00
memory.py	[gemini] APIs to set cpu memory capacity (#809)	2022-04-19 16:05:22 +08:00
moe.py	Refactored docstring to google style	2022-03-29 17:17:47 +08:00
timer.py	Refactored docstring to google style	2022-03-29 17:17:47 +08:00