Hongxin Liu ae02d4e4f7 [bf16] add bf16 support (#3882) ... * [bf16] add bf16 support for fused adam (#3844) * [bf16] fused adam kernel support bf16 * [test] update fused adam kernel test * [test] update fused adam test * [bf16] cpu adam and hybrid adam optimizers support bf16 (#3860) * [bf16] implement mixed precision mixin and add bf16 support for low level zero (#3869) * [bf16] add mixed precision mixin * [bf16] low level zero optim support bf16 * [text] update low level zero test * [text] fix low level zero grad acc test * [bf16] add bf16 support for gemini (#3872) * [bf16] gemini support bf16 * [test] update gemini bf16 test * [doc] update gemini docstring * [bf16] add bf16 support for plugins (#3877) * [bf16] add bf16 support for legacy zero (#3879) * [zero] init context support bf16 * [zero] legacy zero support bf16 * [test] add zero bf16 test * [doc] add bf16 related docstring for legacy zero		2023-06-05 15:58:31 +08:00
..
__init__.py	[booster] support torch fsdp plugin in booster (#3697)	2023-05-15 12:14:38 +08:00
dp_plugin_base.py	[booster] update prepare dataloader method for plugin (#3706)	2023-05-08 15:44:03 +08:00
gemini_plugin.py	[bf16] add bf16 support (#3882)	2023-06-05 15:58:31 +08:00
low_level_zero_plugin.py	[bf16] add bf16 support (#3882)	2023-06-05 15:58:31 +08:00
plugin_base.py	[booster] fix no_sync method (#3709)	2023-05-09 11:10:02 +08:00
torch_ddp_plugin.py	[plugin] torch ddp plugin supports sharded model checkpoint (#3775)	2023-05-18 20:05:59 +08:00
torch_fsdp_plugin.py	[booster] add warning for torch fsdp plugin doc (#3833)	2023-05-25 14:00:02 +08:00