ColossalAI/colossalai/zero/gemini
Hongxin Liu dbb32692d2
[lazy] refactor lazy init (#3891)
* [lazy] remove old lazy init

* [lazy] refactor lazy init folder structure

* [lazy] fix lazy tensor deepcopy

* [test] update lazy init test
2023-06-05 14:20:47 +08:00
..
chunk [NFC]fix typo colossalai/auto_parallel nn utils etc. (#3779) 2023-05-23 15:28:20 +08:00
memory_tracer [NFC]fix typo colossalai/auto_parallel nn utils etc. (#3779) 2023-05-23 15:28:20 +08:00
__init__.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00
colo_init_context.py [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
gemini_ddp.py [lazy] refactor lazy init (#3891) 2023-06-05 14:20:47 +08:00
gemini_hook.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00
gemini_mgr.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00
gemini_optimizer.py [misc] add verbose arg for zero and op builder (#3552) 2023-04-17 11:25:35 +08:00
placement_policy.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00
utils.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00