mirror of https://github.com/hpcaitech/ColossalAI
1a49a5ea00
* support shard optimizer of zero * polish code * support sync grad manually |
||
---|---|---|
.. | ||
__init__.py | ||
dp_plugin_base.py | ||
gemini_plugin.py | ||
low_level_zero_plugin.py | ||
plugin_base.py | ||
torch_ddp_plugin.py | ||
torch_fsdp_plugin.py |