ColossalAI/colossalai/zero/gemini
Baizhou Zhang c6f6005990
[checkpointio] Sharded Optimizer Checkpoint for Gemini Plugin (#4302)
* sharded optimizer checkpoint for gemini plugin

* modify test to reduce testing time

* update doc

* fix bug when keep_gatherd is true under GeminiPlugin
2023-07-21 14:39:01 +08:00
..
chunk [gemini] fix argument naming during chunk configuration searching 2023-06-25 13:34:15 +08:00
memory_tracer [nfc] fix typo colossalai/zero (#3923) 2023-06-08 00:01:29 +08:00
__init__.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00
colo_init_context.py [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
gemini_ddp.py [gemini] fix argument naming during chunk configuration searching 2023-06-25 13:34:15 +08:00
gemini_hook.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00
gemini_mgr.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00
gemini_optimizer.py [checkpointio] Sharded Optimizer Checkpoint for Gemini Plugin (#4302) 2023-07-21 14:39:01 +08:00
placement_policy.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00
utils.py fix typo with colossalai/trainer utils zero (#3908) 2023-06-07 16:08:37 +08:00