ColossalAI

Commit Graph

Author	SHA1	Message	Date
Yuanheng Zhao	55cc7f3df7	[Fix] Fix Inference Example, Tests, and Requirements (#5688 ) * clean requirements * modify example inference struct * add test ci scripts * mark test_infer as submodule * rm deprecated cls & deps * import of HAS_FLASH_ATTN * prune inference tests to be run * prune triton kernel tests * increment pytest timeout mins * revert import path in openmoe	2024-05-08 11:30:15 +08:00
Yuanheng Zhao	e1acb58423	[doc] Add inference/speculative-decoding README (#5552 ) * add README for spec-dec * update roadmap	2024-04-10 11:07:52 +08:00

Author

SHA1

Message

Date

Yuanheng Zhao

55cc7f3df7

[Fix] Fix Inference Example, Tests, and Requirements (#5688 )

* clean requirements

* modify example inference struct

* add test ci scripts

* mark test_infer as submodule

* rm deprecated cls & deps

* import of HAS_FLASH_ATTN

* prune inference tests to be run

* prune triton kernel tests

* increment pytest timeout mins

* revert import path in openmoe

2024-05-08 11:30:15 +08:00

Yuanheng Zhao

e1acb58423

[doc] Add inference/speculative-decoding README (#5552 )

* add README for spec-dec

* update roadmap

2024-04-10 11:07:52 +08:00

2 Commits (feat/online-serving)