ColossalAI/tests/test_infer
yuehuayingxueluo bbfebfb9fc fix bugs in sampler 2024-01-11 13:39:56 +00:00
..
_utils.py [Inference] Add the logic of the inference engine (#5173) 2024-01-11 13:39:56 +00:00
test_config_and_struct.py fix bugs in sampler 2024-01-11 13:39:56 +00:00
test_inference_engine.py fix bugs in sampler 2024-01-11 13:39:56 +00:00
test_kvcache_manager.py [Inference] add logit processor and request handler (#5166) 2024-01-11 13:39:56 +00:00
test_request_handler.py [Inference] add logit processor and request handler (#5166) 2024-01-11 13:39:56 +00:00