github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/colossalai/zero/gemini
History
Hongxin Liu 12eff9eb4c
[gemini] state dict supports fp16 (#3590) 
* [gemini] save state dict support fp16

* [gemini] save state dict shard support fp16

* [gemini] fix state dict

* [gemini] fix state dict
 		2023-04-19 11:01:48 +08:00
..
chunk Add docstr for zero3 chunk search utils (#3572) 2023-04-17 12:44:17 +08:00
memory_tracer [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00
__init__.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00
colo_init_context.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00
gemini_ddp.py [gemini] state dict supports fp16 (#3590) 2023-04-19 11:01:48 +08:00
gemini_hook.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00
gemini_mgr.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00
gemini_optimizer.py [misc] add verbose arg for zero and op builder (#3552) 2023-04-17 11:25:35 +08:00
placement_policy.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00
utils.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00