ColossalAI/tests
Li Xingjian 8554585a5f
[Inference] Fix flash-attn import and add model test (#5794)
* Fix torch int32 dtype

Signed-off-by: char-1ee <xingjianli59@gmail.com>

* Fix flash-attn import

Signed-off-by: char-1ee <xingjianli59@gmail.com>

* Add generalized model test

Signed-off-by: char-1ee <xingjianli59@gmail.com>

* Remove exposed path to model

Signed-off-by: char-1ee <xingjianli59@gmail.com>

* Add default value for use_flash_attn

Signed-off-by: char-1ee <xingjianli59@gmail.com>

* Rename model test

Signed-off-by: char-1ee <xingjianli59@gmail.com>

---------

Signed-off-by: char-1ee <xingjianli59@gmail.com>
2024-06-12 14:13:50 +08:00
..
kit [test] fix chatglm test kit (#5793) 2024-06-11 16:54:31 +08:00
test_analyzer [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_auto_parallel [test] Fix/fix testcase (#5770) 2024-06-03 15:26:01 +08:00
test_autochunk [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_booster [release] update version (#5752) 2024-05-31 19:40:26 +08:00
test_checkpoint_io [Test/CI] remove test cases to reduce CI duration (#5753) 2024-06-05 11:29:04 +08:00
test_cluster [misc] refactor launch API and tensor constructor (#5666) 2024-04-29 10:40:11 +08:00
test_config [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_device [misc] refactor launch API and tensor constructor (#5666) 2024-04-29 10:40:11 +08:00
test_fx [hotfix] fix testcase in test_fx/test_tracer (#5779) 2024-06-05 11:29:32 +08:00
test_infer [Inference] Fix flash-attn import and add model test (#5794) 2024-06-12 14:13:50 +08:00
test_lazy [lazyinit] skip whisper test (#5653) 2024-04-26 14:03:12 +08:00
test_legacy [misc] refactor launch API and tensor constructor (#5666) 2024-04-29 10:40:11 +08:00
test_lora [misc] refactor launch API and tensor constructor (#5666) 2024-04-29 10:40:11 +08:00
test_moe [misc] refactor launch API and tensor constructor (#5666) 2024-04-29 10:40:11 +08:00
test_optimizer [misc] Accelerate CI for zero and dist optim (#5758) 2024-06-05 11:25:19 +08:00
test_pipeline [misc] refactor launch API and tensor constructor (#5666) 2024-04-29 10:40:11 +08:00
test_shardformer [test] fix qwen2 pytest distLarge (#5797) 2024-06-12 12:13:51 +08:00
test_smoothquant [inference] Add smmoothquant for llama (#4904) 2023-10-16 11:28:44 +08:00
test_tensor [misc] refactor launch API and tensor constructor (#5666) 2024-04-29 10:40:11 +08:00
test_zero [Test/CI] remove test cases to reduce CI duration (#5753) 2024-06-05 11:29:04 +08:00
__init__.py [zero] Update sharded model v2 using sharded param v2 (#323) 2022-03-11 15:50:28 +08:00