mirror of https://github.com/hpcaitech/ColossalAI
4f68b3f10c
* [kernel] support pure fp16 for cpu adam (#4896) * [kernel] fix cpu adam kernel for pure fp16 and update tests (#4919) * [kernel] fix cpu adam * [test] update gemini optim test |
||
---|---|---|
.. | ||
csrc | ||
mha | ||
__init__.py | ||
layer_norm.py | ||
multihead_attention.py | ||
scaled_softmax.py |