ColossalAI/tests/test_zero/test_gemini
Hongxin Liu e5ce4c8ea6
[npu] add npu support for gemini and zero (#5067)
* [npu] setup device utils (#5047)

* [npu] add npu device support

* [npu] support low level zero

* [test] update npu zero plugin test

* [hotfix] fix import

* [test] recover tests

* [npu] gemini support npu (#5052)

* [npu] refactor device utils

* [gemini] support npu

* [example] llama2+gemini support npu

* [kernel] add arm cpu adam kernel (#5065)

* [kernel] add arm cpu adam

* [optim] update adam optimizer

* [kernel] arm cpu adam remove bf16 support
2023-11-20 16:12:41 +08:00
..
test_chunk_mgrv2.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_chunkv2.py [gemini] gemini support extra-dp (#5043) 2023-11-16 21:03:04 +08:00
test_fwd_bwd.py [npu] add npu support for gemini and zero (#5067) 2023-11-20 16:12:41 +08:00
test_gemini_use_rmt.py [test] merge old components to test to model zoo (#4945) 2023-10-20 10:35:08 +08:00
test_grad_accum.py [npu] add npu support for gemini and zero (#5067) 2023-11-20 16:12:41 +08:00
test_grad_clip.py [hotfix] fix grad accumulation plus clipping for gemini (#5002) 2023-11-02 17:59:10 +08:00
test_inference.py [npu] add npu support for gemini and zero (#5067) 2023-11-20 16:12:41 +08:00
test_optim.py [npu] add npu support for gemini and zero (#5067) 2023-11-20 16:12:41 +08:00
test_runtime_mem_tracer.py [test] merge old components to test to model zoo (#4945) 2023-10-20 10:35:08 +08:00
test_search.py [test] merge old components to test to model zoo (#4945) 2023-10-20 10:35:08 +08:00
test_zeroddp_state_dict.py [test] merge old components to test to model zoo (#4945) 2023-10-20 10:35:08 +08:00
test_zerooptim_state_dict.py [test] merge old components to test to model zoo (#4945) 2023-10-20 10:35:08 +08:00