ColossalAI/examples/inference
Xu Kai d1fcc0fa4d
[infer] fix test bug (#4838)
* fix test bug

* delete useless code

* fix typo
2023-10-04 10:01:03 +08:00
..
serving [Infer] Serving example w/ ray-serve (multiple GPU case) (#4841) 2023-10-02 17:48:38 +08:00
bench_bloom.py
bench_llama.py [infer] fix test bug (#4838) 2023-10-04 10:01:03 +08:00
gptq_bloom.py
gptq_llama.py [inference]fix import bug and delete down useless init (#4830) 2023-10-04 09:18:45 +08:00