github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/examples/inference
History
Hongxin Liu 1cd7efc520
[inference] refactor examples and fix schedule (#5077) 
* [setup] refactor infer setup

* [hotfix] fix infenrece behavior on 1 1 gpu

* [exmaple] refactor inference examples
 		2023-11-21 10:46:03 +08:00
..
benchmark_llama.py [inference] refactor examples and fix schedule (#5077) 2023-11-21 10:46:03 +08:00
build_smoothquant_weight.py [inference] refactor examples and fix schedule (#5077) 2023-11-21 10:46:03 +08:00
run_benchmark.sh [inference] refactor examples and fix schedule (#5077) 2023-11-21 10:46:03 +08:00
run_llama_inference.py [inference] refactor examples and fix schedule (#5077) 2023-11-21 10:46:03 +08:00