ColossalAI/colossalai/inference/modeling
Runyu Lu c0948aff97
[Inference]refactor baichuan (#5791)
* refactor baichuan

* remove unused code and add TODO for lazyinit
2024-06-11 10:52:01 +08:00
..
backends Remove flash attention backend 2024-06-07 10:02:19 +00:00
layers [Inference]refactor baichuan (#5791) 2024-06-11 10:52:01 +08:00
models [Inference]refactor baichuan (#5791) 2024-06-11 10:52:01 +08:00
policy [Inference]refactor baichuan (#5791) 2024-06-11 10:52:01 +08:00
__init__.py [doc] updated inference readme (#5343) 2024-02-02 14:31:10 +08:00