ver217 51b9a49655 [zero] add zero optimizer for ColoTensor (#1046) ... * add zero optimizer * torch ok * unit test ok * polish code * fix bugs * polish unit test * polish zero optim * polish colo ddp v2 * refactor folder structure * add comment * polish unit test * polish zero optim * polish unit test		2022-06-02 12:13:15 +08:00
..
init_ctx	[zero] add load_state_dict for sharded model (#894)	2022-05-27 10:25:08 +08:00
shard_utils	[gemini] add GeminiMemoryManger (#832)	2022-04-24 13:08:48 +08:00
sharded_model	[zero] add load_state_dict for sharded model (#894)	2022-05-27 10:25:08 +08:00
sharded_optim	[gemini] accelerate adjust_layout() (#878)	2022-04-26 18:08:31 +08:00
sharded_param	[gemini] add GeminiMemoryManger (#832)	2022-04-24 13:08:48 +08:00
utils	[zero] add zero optimizer for ColoTensor (#1046)	2022-06-02 12:13:15 +08:00
__init__.py	[zero] add zero optimizer for ColoTensor (#1046)	2022-06-02 12:13:15 +08:00
zero_optimizer.py	[zero] add zero optimizer for ColoTensor (#1046)	2022-06-02 12:13:15 +08:00