ColossalAI/colossalai/kernel/cuda_native
Hongxin Liu 4f68b3f10c
[kernel] support pure fp16 for cpu adam and update gemini optim tests (#4921)
* [kernel] support pure fp16 for cpu adam (#4896)

* [kernel] fix cpu adam kernel for pure fp16 and update tests (#4919)

* [kernel] fix cpu adam

* [test] update gemini optim test
2023-10-16 21:56:53 +08:00
..
csrc [kernel] support pure fp16 for cpu adam and update gemini optim tests (#4921) 2023-10-16 21:56:53 +08:00
mha [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
__init__.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
layer_norm.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
multihead_attention.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
scaled_softmax.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00