ColossalAI/colossalai/kernel/triton
Jianghai ce7ade3882
[inference] chatglm2 infer demo (#4724)
* add chatglm2

* add

* gather needed kernels

* fix some bugs

* finish context forward

* finish context stage

* fix

* add

* pause

* add

* fix bugs

* finish chatglm

* fix bug

* change some logic

* fix bugs

* change some logics

* add

* add

* add

* fix

* fix tests

* fix
2023-09-22 11:12:50 +08:00
..
__init__.py
context_attention.py [inference] chatglm2 infer demo (#4724) 2023-09-22 11:12:50 +08:00
copy_kv_cache_dest.py
fused_layernorm.py
gptq_triton.py
qkv_matmul_kernel.py
rms_norm.py
rotary_embedding_kernel.py [inference] chatglm2 infer demo (#4724) 2023-09-22 11:12:50 +08:00
self_attention_nofusion.py
softmax.py
token_attention_kernel.py [inference] chatglm2 infer demo (#4724) 2023-09-22 11:12:50 +08:00