ColossalAI/colossalai/inference/core
Runyu Lu bcf0181ecd
[Feat] Distrifusion Acceleration Support for Diffusion Inference (#5895)
* Distrifusion Support source

* comp comm overlap optimization

* sd3 benchmark

* pixart distrifusion bug fix

* sd3 bug fix and benchmark

* generation bug fix

* naming fix

* add docstring, fix counter and shape error

* add reference

* readme and requirement
2024-07-30 10:43:26 +08:00
..
__init__.py [doc] updated inference readme (#5343) 2024-02-02 14:31:10 +08:00
async_engine.py [Inference] Fix API server, test and example (#5712) 2024-05-15 15:47:31 +08:00
base_engine.py [Feat] Diffusion Model(PixArtAlpha/StableDiffusion3) Support (#5838) 2024-07-08 16:02:07 +08:00
diffusion_engine.py [Feat] Distrifusion Acceleration Support for Diffusion Inference (#5895) 2024-07-30 10:43:26 +08:00
engine.py [Feat] Diffusion Model(PixArtAlpha/StableDiffusion3) Support (#5838) 2024-07-08 16:02:07 +08:00
llm_engine.py [HotFix] CI,import,requirements-test for #5838 (#5892) 2024-07-08 22:32:06 +08:00
plugin.py [Feat]Tensor Model Parallel Support For Inference (#5563) 2024-04-18 16:56:46 +08:00
request_handler.py [Feat] Diffusion Model(PixArtAlpha/StableDiffusion3) Support (#5838) 2024-07-08 16:02:07 +08:00
rpc_engine.py [pre-commit.ci] pre-commit autoupdate (#5572) 2024-07-01 17:16:41 +08:00