ColossalAI/colossalai/zero
LuGY 45b08f08cb [zero] optimize the optimizer step time (#4221)
* optimize the optimizer step time

* fix corner case

* polish

* replace all-reduce with all-gather

* set comm device to cuda
2023-07-31 22:13:29 +08:00
..
gemini [checkpointio] Sharded Optimizer Checkpoint for Gemini Plugin (#4302) 2023-07-21 14:39:01 +08:00
legacy [nfc] fix typo colossalai/zero (#3923) 2023-06-08 00:01:29 +08:00
low_level [zero] optimize the optimizer step time (#4221) 2023-07-31 22:13:29 +08:00
__init__.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00
wrapper.py [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00