You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/colossalai/inference/spec
Yuanheng Zhao 7b249c76e5
[Fix] Fix spec-dec Glide LlamaModel for compatibility with transformers (#5837)
5 months ago
..
__init__.py [Inference/SpecDec] Support GLIDE Drafter Model (#5455) 8 months ago
drafter.py [Inference/SpecDec] Support GLIDE Drafter Model (#5455) 8 months ago
struct.py [Fix] Fix spec-dec Glide LlamaModel for compatibility with transformers (#5837) 5 months ago