ColossalAI/colossalai/legacy/inference/hybridengine
yuehuayingxueluo fa4fbdbffb adapted to pad_context_forward 2024-01-11 13:44:06 +00:00
..
modeling [inference] Refactor inference architecture (#5057) 2023-11-19 21:05:05 +08:00
polices [inference] Refactor inference architecture (#5057) 2023-11-19 21:05:05 +08:00
__init__.py [inference] Refactor inference architecture (#5057) 2023-11-19 21:05:05 +08:00
engine.py adapted to pad_context_forward 2024-01-11 13:44:06 +00:00