Zhongkai Zhao 75af66cd81 [Hotfix] Fix model policy matching strategy in ShardFormer (#5064) ... * hotfix/Fix get model policy strategy in ShardFormer * fix bug in auto policy		2023-11-22 11:19:39 +08:00
..
_utils.py	[Hotfix] Fix model policy matching strategy in ShardFormer (#5064)	2023-11-22 11:19:39 +08:00
test_hybrid_bloom.py	[inference] update examples and engine (#5073)	2023-11-20 19:44:52 +08:00
test_hybrid_chatglm2.py	[inference] update examples and engine (#5073)	2023-11-20 19:44:52 +08:00
test_hybrid_llama.py	[inference] update examples and engine (#5073)	2023-11-20 19:44:52 +08:00
test_kvcache_manager.py	[inference] Refactor inference architecture (#5057)	2023-11-19 21:05:05 +08:00