ColossalAI/colossalai/zero/gemini
Baizhou Zhang c0a033700c
[shardformer] fix master param sync for hybrid plugin/rewrite unwrapping logic (#4758)
* fix master param sync for hybrid plugin

* rewrite unwrap for ddp/fsdp

* rewrite unwrap for zero/gemini

* rewrite unwrap for hybrid plugin

* fix geemini unwrap

* fix bugs
2023-09-20 18:29:37 +08:00
..
chunk [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
memory_tracer [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
__init__.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
colo_init_context.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
gemini_ddp.py [shardformer] fix master param sync for hybrid plugin/rewrite unwrapping logic (#4758) 2023-09-20 18:29:37 +08:00
gemini_hook.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
gemini_mgr.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
gemini_optimizer.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
placement_policy.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
utils.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00