littsk 83b52c56cd [feature] Add clip_grad_norm for hybrid_parallel_plugin (#4837) ... * Add clip_grad_norm for hibrid_parallel_plugin * polish code * add unittests * Move tp to a higher-level optimizer interface. * bug fix * polish code		2023-10-12 11:32:37 +08:00
..
__init__.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
dp_plugin_base.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
gemini_plugin.py	[gemini] support amp o3 for gemini (#4872)	2023-10-12 10:39:08 +08:00
hybrid_parallel_plugin.py	[feature] Add clip_grad_norm for hybrid_parallel_plugin (#4837)	2023-10-12 11:32:37 +08:00
low_level_zero_plugin.py	fix: typo in comment of low_level_zero plugin	2023-10-05 16:30:34 +00:00
plugin_base.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
pp_plugin_base.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
torch_ddp_plugin.py	[doc] polish shardformer doc (#4779)	2023-09-26 10:57:47 +08:00
torch_fsdp_plugin.py	[doc] polish shardformer doc (#4779)	2023-09-26 10:57:47 +08:00