ColossalAI

Commit Graph

Author	SHA1	Message	Date
Yuanheng Zhao	55cc7f3df7	[Fix] Fix Inference Example, Tests, and Requirements (#5688 ) * clean requirements * modify example inference struct * add test ci scripts * mark test_infer as submodule * rm deprecated cls & deps * import of HAS_FLASH_ATTN * prune inference tests to be run * prune triton kernel tests * increment pytest timeout mins * revert import path in openmoe	7 months ago
Yuanheng Zhao	e1acb58423	[doc] Add inference/speculative-decoding README (#5552 ) * add README for spec-dec * update roadmap	8 months ago

Author

SHA1

Message

Date

Yuanheng Zhao

55cc7f3df7

[Fix] Fix Inference Example, Tests, and Requirements (#5688 )

* clean requirements

* modify example inference struct

* add test ci scripts

* mark test_infer as submodule

* rm deprecated cls & deps

* import of HAS_FLASH_ATTN

* prune inference tests to be run

* prune triton kernel tests

* increment pytest timeout mins

* revert import path in openmoe

Yuanheng Zhao

e1acb58423

[doc] Add inference/speculative-decoding README (#5552 )

* add README for spec-dec

* update roadmap

2 Commits (5d9a49483d98ccd4bebebbfd039162caceefe6bd)