ColossalAI/examples/language
Hongxin Liu e5ce4c8ea6
[npu] add npu support for gemini and zero (#5067)
* [npu] setup device utils (#5047)

* [npu] add npu device support

* [npu] support low level zero

* [test] update npu zero plugin test

* [hotfix] fix import

* [test] recover tests

* [npu] gemini support npu (#5052)

* [npu] refactor device utils

* [gemini] support npu

* [example] llama2+gemini support npu

* [kernel] add arm cpu adam kernel (#5065)

* [kernel] add arm cpu adam

* [optim] update adam optimizer

* [kernel] arm cpu adam remove bf16 support
2023-11-20 16:12:41 +08:00
..
bert [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
commons [example] make gpt example directory more clear (#2353) 2023-01-06 11:11:26 +08:00
gpt [bug] fix get_default_parser in examples (#4764) 2023-09-21 10:42:25 +08:00
llama2 [npu] add npu support for gemini and zero (#5067) 2023-11-20 16:12:41 +08:00
openmoe [moe]: fix ep/tp tests, add hierarchical all2all (#4982) 2023-11-09 06:31:00 +00:00
opt [bug] fix get_default_parser in examples (#4764) 2023-09-21 10:42:25 +08:00
palm [nfc] fix minor typo in README (#4846) 2023-10-07 17:51:11 +08:00