mirror of https://github.com/hpcaitech/ColossalAI
d85d91435a
* add glide-llama policy and modeling * update glide modeling, compitable with transformers 4.36.2 * revise glide llama modeling/usage * fix issues of glimpsing large kv * revise the way re-loading params for glide drafter * fix drafter and engine tests * enable convert to glide strict=False * revise glide llama modeling * revise vicuna prompt template * revise drafter and tests * apply usage of glide model in engine |
||
|---|---|---|
| .. | ||
| layers | ||
| models | ||
| policy | ||
| __init__.py | ||