github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/colossalai/inference/spec
History
Yuanheng Zhao 5a9b05f7b2 [Inference/SpecDec] Add Basic Drafter Model Container (#5405) 
* [Infer/Fix] Fix Dependency in test - RMSNorm kernel (#5399)

fix dependency in pytest

* add drafter model container (basic ver)
 		2024-04-10 11:07:51 +08:00
..
__init__.py [Inference/SpecDec] Add Basic Drafter Model Container (#5405) 2024-04-10 11:07:51 +08:00
drafter.py [Inference/SpecDec] Add Basic Drafter Model Container (#5405) 2024-04-10 11:07:51 +08:00
struct.py [Inference/SpecDec] Add Basic Drafter Model Container (#5405) 2024-04-10 11:07:51 +08:00