ColossalAI/colossalai/zero/gemini
Hongxin Liu f313babd11
[gemini] support save state dict in shards (#3581)
* [gemini] support state dict shard

* [gemini] add test state dict shard

* [gemini] polish docstr

* [gemini] fix merge

* [gemini] polish code
2023-04-17 17:11:09 +08:00
..
chunk Add docstr for zero3 chunk search utils (#3572) 2023-04-17 12:44:17 +08:00
memory_tracer [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00
__init__.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00
colo_init_context.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00
gemini_ddp.py [gemini] support save state dict in shards (#3581) 2023-04-17 17:11:09 +08:00
gemini_hook.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00
gemini_mgr.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00
gemini_optimizer.py [misc] add verbose arg for zero and op builder (#3552) 2023-04-17 11:25:35 +08:00
placement_policy.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00
utils.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00