ColossalAI/examples/inference
Bin Jia 4e3959d316
[hotfix/hybridengine] Fix init model with random parameters in benchmark (#5074)
* fix init model with random parameters

* fix example
2023-11-20 20:15:25 +08:00
..
_utils.py [Inference]ADD Bench Chatglm2 script (#4963) 2023-10-24 13:11:15 +08:00
benchmark.py [hotfix/hybridengine] Fix init model with random parameters in benchmark (#5074) 2023-11-20 20:15:25 +08:00
build_smoothquant_weight.py [inference] update examples and engine (#5073) 2023-11-20 19:44:52 +08:00
run_benchmark.sh [hotfix/hybridengine] Fix init model with random parameters in benchmark (#5074) 2023-11-20 20:15:25 +08:00
run_llama_inference.py [inference] update examples and engine (#5073) 2023-11-20 19:44:52 +08:00