ColossalAI/colossalai/zero
LuGY 839847b7d7
[zero]support zero2 with gradient accumulation (#4511)
* support gradient accumulation with zero2

* fix type
2023-08-25 13:44:07 +08:00
..
gemini [gemini] improve compatibility and add static placement policy (#4479) 2023-08-24 09:29:25 +08:00
legacy [nfc] fix typo colossalai/zero (#3923) 2023-06-08 00:01:29 +08:00
low_level [zero]support zero2 with gradient accumulation (#4511) 2023-08-25 13:44:07 +08:00
__init__.py [gemini] improve compatibility and add static placement policy (#4479) 2023-08-24 09:29:25 +08:00
wrapper.py [gemini] improve compatibility and add static placement policy (#4479) 2023-08-24 09:29:25 +08:00