ColossalAI/colossalai/inference/modeling/policy
Yuanheng Zhao 1dedb57747
[Fix/Infer] Remove unused deps and revise requirements (#5341)
* remove flash-attn dep

* rm padding llama

* revise infer requirements

* move requirements out of module
2024-02-06 17:27:45 +08:00
..
__init__.py [Fix/Infer] Remove unused deps and revise requirements (#5341) 2024-02-06 17:27:45 +08:00
nopadding_llama.py [Inference/opt]Optimize the mid tensor of RMS Norm (#5350) 2024-02-02 15:06:01 +08:00