github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/tests/test_infer_ops/triton
History
Jianghai ce7ade3882
[inference] chatglm2 infer demo (#4724) 
* add chatglm2

* add

* gather needed kernels

* fix some bugs

* finish context forward

* finish context stage

* fix

* add

* pause

* add

* fix bugs

* finish chatglm

* fix bug

* change some logic

* fix bugs

* change some logics

* add

* add

* add

* fix

* fix tests

* fix
 		2023-09-22 11:12:50 +08:00
..
kernel_utils.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_bloom_context_attention.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_copy_kv_dest.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_layernorm_triton.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_llama2_token_attn.py [inference] chatglm2 infer demo (#4724) 2023-09-22 11:12:50 +08:00
test_llama_context_attention.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_rotary_embedding.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_self_attention_nonfusion.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_softmax.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_token_attn_1.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_token_attn_2.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_token_attn_fwd.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_token_softmax.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00