ColossalAI/colossalai/booster/plugin
Hongxin Liu 807e01a4ba
[zero] hotfix master param sync (#4618)
* [zero] add method to update master params

* [zero] update zero plugin

* [plugin] update low level zero plugin
2023-09-05 15:04:02 +08:00
..
__init__.py [plugin] add 3d parallel plugin (#4295) 2023-08-15 23:25:14 +08:00
dp_plugin_base.py [booster] update prepare dataloader method for plugin (#3706) 2023-05-08 15:44:03 +08:00
gemini_plugin.py [gemini] improve compatibility and add static placement policy (#4479) 2023-08-24 09:29:25 +08:00
hybrid_parallel_plugin.py [shardformer] test all optimizations (#4399) 2023-08-15 23:25:14 +08:00
low_level_zero_plugin.py [zero] hotfix master param sync (#4618) 2023-09-05 15:04:02 +08:00
plugin_base.py [zero]support no_sync method for zero1 plugin (#4138) 2023-07-31 22:13:29 +08:00
pp_plugin_base.py [plugin] add 3d parallel plugin (#4295) 2023-08-15 23:25:14 +08:00
torch_ddp_plugin.py [zero]support no_sync method for zero1 plugin (#4138) 2023-07-31 22:13:29 +08:00
torch_fsdp_plugin.py [zero]support no_sync method for zero1 plugin (#4138) 2023-07-31 22:13:29 +08:00