Xu Kai c6295c3381 [Refactor] remove useless inference code (#5022) ... * remove useless code * fix quant model * fix test import bug * mv original inference legacy * fix chatglm2		2023-11-10 14:47:06 +08:00
..
kernel_utils.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
test_bloom_context_attention.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
test_copy_kv_dest.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
test_layernorm_triton.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
test_llama_act_combine.py	[moe] merge moe into main (#4978)	2023-11-02 02:21:24 +00:00
test_llama_context_attention.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
test_self_attention_nonfusion.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
test_softmax.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
test_token_attn_fwd.py	[Refactor] remove useless inference code (#5022)	2023-11-10 14:47:06 +08:00
test_token_softmax.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00