ColossalAI/colossalai
Baizhou Zhang c0a033700c
[shardformer] fix master param sync for hybrid plugin/rewrite unwrapping logic (#4758)
* fix master param sync for hybrid plugin

* rewrite unwrap for ddp/fsdp

* rewrite unwrap for zero/gemini

* rewrite unwrap for hybrid plugin

* fix geemini unwrap

* fix bugs
2023-09-20 18:29:37 +08:00
..
_C [setup] support pre-build and jit-build of cuda kernels (#2374) 2023-01-06 20:50:26 +08:00
_analyzer [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
amp [shardformer] fix master param sync for hybrid plugin/rewrite unwrapping logic (#4758) 2023-09-20 18:29:37 +08:00
auto_parallel [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
autochunk [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
booster [shardformer] fix master param sync for hybrid plugin/rewrite unwrapping logic (#4758) 2023-09-20 18:29:37 +08:00
checkpoint_io [shardformer] fix master param sync for hybrid plugin/rewrite unwrapping logic (#4758) 2023-09-20 18:29:37 +08:00
cli [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
cluster [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
context [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
device [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
fx [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
inference [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
interface [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
kernel [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
lazy [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
legacy [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
logging [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
nn [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
pipeline [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
shardformer [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
tensor [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
testing [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
utils [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
zero [shardformer] fix master param sync for hybrid plugin/rewrite unwrapping logic (#4758) 2023-09-20 18:29:37 +08:00
__init__.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
initialize.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00