ColossalAI/tests/test_infer
Jianghai 93aeacca34 [Inference]Update inference config and fix test (#5178)
* unify the config setting

* fix test

* fix import

* fix test

* fix

* fix

* add logger

* revise log info

---------

Co-authored-by: CjhHa1 <cjh18671720497outlook.com>
2024-01-11 13:39:29 +00:00
..
_utils.py [Hotfix] Fix model policy matching strategy in ShardFormer (#5064) 2023-11-22 11:19:39 +08:00
test_config_and_struct.py [Inference]Update inference config and fix test (#5178) 2024-01-11 13:39:29 +00:00
test_kvcache_manager.py [Inference]Update inference config and fix test (#5178) 2024-01-11 13:39:29 +00:00