ColossalAI/colossalai/nn
Hongxin Liu 4f68b3f10c
[kernel] support pure fp16 for cpu adam and update gemini optim tests (#4921)
* [kernel] support pure fp16 for cpu adam (#4896)

* [kernel] fix cpu adam kernel for pure fp16 and update tests (#4919)

* [kernel] fix cpu adam

* [test] update gemini optim test
2023-10-16 21:56:53 +08:00
..
layer [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
loss [legacy] clean up legacy code (#4743) 2023-09-18 16:31:06 +08:00
lr_scheduler [hotfix] fix lr scheduler bug in torch 2.0 (#4864) 2023-10-12 14:04:24 +08:00
optimizer [kernel] support pure fp16 for cpu adam and update gemini optim tests (#4921) 2023-10-16 21:56:53 +08:00
__init__.py [legacy] move communication and nn to legacy and refactor logger (#4671) 2023-09-11 16:24:28 +08:00
init.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00