You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Hongxin Liu ae02d4e4f7 [bf16] add bf16 support (#3882) ... * [bf16] add bf16 support for fused adam (#3844) * [bf16] fused adam kernel support bf16 * [test] update fused adam kernel test * [test] update fused adam test * [bf16] cpu adam and hybrid adam optimizers support bf16 (#3860) * [bf16] implement mixed precision mixin and add bf16 support for low level zero (#3869) * [bf16] add mixed precision mixin * [bf16] low level zero optim support bf16 * [text] update low level zero test * [text] fix low level zero grad acc test * [bf16] add bf16 support for gemini (#3872) * [bf16] gemini support bf16 * [test] update gemini bf16 test * [doc] update gemini docstring * [bf16] add bf16 support for plugins (#3877) * [bf16] add bf16 support for legacy zero (#3879) * [zero] init context support bf16 * [zero] legacy zero support bf16 * [test] add zero bf16 test * [doc] add bf16 related docstring for legacy zero		1 year ago
..
grad_scaler	[zero] fix gradient clipping in hybrid parallelism (#2521)	2 years ago
mixed_precision_mixin	[bf16] add bf16 support (#3882)	1 year ago
__init__.py	[NFC] polish colossalai/amp/naive_amp/__init__.py code style (#1905)	2 years ago
_fp16_optimizer.py	[setup] support pre-build and jit-build of cuda kernels (#2374)	2 years ago
_utils.py	…
naive_amp.py	[amp] add gradient clipping for unit tests (#2283)	2 years ago