github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/colossalai/inference/kvcache_manager
History
Xu Kai c6295c3381
[Refactor] remove useless inference code (#5022) 
* remove useless code

* fix quant model

* fix test import bug

* mv original inference legacy

* fix chatglm2
 		2023-11-10 14:47:06 +08:00
..
__init__.py [Refactor] remove useless inference code (#5022) 2023-11-10 14:47:06 +08:00
batch_infer_state.py [Refactor] remove useless inference code (#5022) 2023-11-10 14:47:06 +08:00
kvcache_manager.py [Refactor] remove useless inference code (#5022) 2023-11-10 14:47:06 +08:00