mirror of https://github.com/hpcaitech/ColossalAI
e5ce4c8ea6
* [npu] setup device utils (#5047) * [npu] add npu device support * [npu] support low level zero * [test] update npu zero plugin test * [hotfix] fix import * [test] recover tests * [npu] gemini support npu (#5052) * [npu] refactor device utils * [gemini] support npu * [example] llama2+gemini support npu * [kernel] add arm cpu adam kernel (#5065) * [kernel] add arm cpu adam * [optim] update adam optimizer * [kernel] arm cpu adam remove bf16 support |
||
---|---|---|
.. | ||
__init__.py | ||
flash_attn_2.py | ||
mem_eff_attn.py | ||
mha.py | ||
utils.py |