ColossalAI/colossalai/zero/gemini
Hongxin Liu 152239bbfa
[gemini] gemini supports lazy init (#3379)
* [gemini] fix nvme optimizer init

* [gemini] gemini supports lazy init

* [gemini] add init example

* [gemini] add fool model

* [zero] update gemini ddp

* [zero] update init example

* add chunk method

* add chunk method

* [lazyinit] fix lazy tensor tolist

* [gemini] fix buffer materialization

* [misc] remove useless file

* [booster] update gemini plugin

* [test] update gemini plugin test

* [test] fix gemini plugin test

* [gemini] fix import

* [gemini] fix import

* [lazyinit] use new metatensor

* [lazyinit] use new metatensor

* [lazyinit] fix __set__ method
2023-04-12 16:03:25 +08:00
..
chunk [gemini] gemini supports lazy init (#3379) 2023-04-12 16:03:25 +08:00
memory_tracer [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00
__init__.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00
colo_init_context.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00
gemini_ddp.py [gemini] gemini supports lazy init (#3379) 2023-04-12 16:03:25 +08:00
gemini_hook.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00
gemini_mgr.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00
gemini_optimizer.py [doc] Add docs for clip args in zero optim (#3504) 2023-04-10 11:11:28 +08:00
placement_policy.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00
utils.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00