ColossalAI/colossalai/inference/engine
Hongxin Liu f196f40a8f
[inference] decouple pipeline logci for chatglm (#5098)
* [inference] decouple pipeline logci for chatglm

* [inference] fix chatglm modeling
2023-11-22 18:26:39 +08:00
..
modeling [inference] decouple pipeline logci for chatglm (#5098) 2023-11-22 18:26:39 +08:00
policies [hotfix]fix chatglm rmsnorm (#5079) 2023-11-22 17:59:22 +08:00
__init__.py [inference] update examples and engine (#5073) 2023-11-20 19:44:52 +08:00
engine.py [inference] decouple pipeline logci for chatglm (#5098) 2023-11-22 18:26:39 +08:00
microbatch_manager.py [inference] Refactor inference architecture (#5057) 2023-11-19 21:05:05 +08:00