Hongxin Liu ae02d4e4f7 [bf16] add bf16 support (#3882) ... * [bf16] add bf16 support for fused adam (#3844) * [bf16] fused adam kernel support bf16 * [test] update fused adam kernel test * [test] update fused adam test * [bf16] cpu adam and hybrid adam optimizers support bf16 (#3860) * [bf16] implement mixed precision mixin and add bf16 support for low level zero (#3869) * [bf16] add mixed precision mixin * [bf16] low level zero optim support bf16 * [text] update low level zero test * [text] fix low level zero grad acc test * [bf16] add bf16 support for gemini (#3872) * [bf16] gemini support bf16 * [test] update gemini bf16 test * [doc] update gemini docstring * [bf16] add bf16 support for plugins (#3877) * [bf16] add bf16 support for legacy zero (#3879) * [zero] init context support bf16 * [zero] legacy zero support bf16 * [test] add zero bf16 test * [doc] add bf16 related docstring for legacy zero		2023-06-05 15:58:31 +08:00
..
_ops	[doc] Fix typo under colossalai and doc(#3618)	2023-04-26 11:38:43 +08:00
layer	[doc] Fix typo under colossalai and doc(#3618)	2023-04-26 11:38:43 +08:00
loss	[NFC] polish colossalai/nn/loss/loss_2p5d.py code style (#1553)	2022-09-08 22:11:04 +08:00
lr_scheduler	[NFC] polish colossalai/nn/lr_scheduler/linear.py code style (#1716)	2022-10-19 12:20:51 +08:00
metric	[NFC] polish colossalai/nn/metric/_utils.py code style (#1727)	2022-10-19 12:20:51 +08:00
optimizer	[bf16] add bf16 support (#3882)	2023-06-05 15:58:31 +08:00
parallel	[NFC]fix typo colossalai/auto_parallel nn utils etc. (#3779)	2023-05-23 15:28:20 +08:00
__init__.py	[kernel] added jit warmup (#1792)	2022-11-08 16:22:23 +08:00
init.py	[NFC] polish colossalai/nn/init.py code style (#1292)	2022-07-13 10:51:55 +08:00