ColossalAI/colossalai/shardformer/modeling
Jianghai ce7ade3882
[inference] chatglm2 infer demo (#4724)
* add chatglm2

* add

* gather needed kernels

* fix some bugs

* finish context forward

* finish context stage

* fix

* add

* pause

* add

* fix bugs

* finish chatglm

* fix bug

* change some logic

* fix bugs

* change some logics

* add

* add

* add

* fix

* fix tests

* fix
2023-09-22 11:12:50 +08:00
..
chatglm2_6b [inference] chatglm2 infer demo (#4724) 2023-09-22 11:12:50 +08:00
__init__.py
bert.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
blip2.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
bloom.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
chatglm2.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
gpt2.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
jit.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
llama.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
opt.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
sam.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
t5.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
vit.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
whisper.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00