ColossalAI/colossalai/inference/modeling/policy
char-1ee 5f398fc000 Pass inference model shard configs for module init
Signed-off-by: char-1ee <xingjianli59@gmail.com>
2024-06-07 08:33:52 +00:00
..
__init__.py [inference/model]Adapted to the baichuan2-7B model (#5591) 2024-04-15 16:53:02 +08:00
glide_llama.py [Inference/SpecDec] Support GLIDE Drafter Model (#5455) 2024-04-10 11:07:52 +08:00
nopadding_baichuan.py Pass inference model shard configs for module init 2024-06-07 08:33:52 +00:00
nopadding_llama.py Pass inference model shard configs for module init 2024-06-07 08:33:52 +00:00