ColossalAI

Commit Graph

Author	SHA1	Message	Date
yuehuayingxueluo	35382a7fbf	[Inference]Fused the gate and up proj in mlp，and optimized the autograd process. (#5365 ) * fused the gate and up proj in mlp * fix code styles * opt auto_grad * rollback test_inference_engine.py * modifications based on the review feedback. * fix bugs in flash attn * Change reshape to view * fix test_rmsnorm_triton.py	10 months ago
Jianghai	7ddd8b37f0	fix (#5311 )	10 months ago
Jianghai	c647e00e3c	[Inference]Add fused rotary kernel and get cos cache kernel (#5302 ) * add fused rotary and get cos cache func * staged * fix bugs * fix bugs	10 months ago

Author

SHA1

Message

Date

yuehuayingxueluo

35382a7fbf

[Inference]Fused the gate and up proj in mlp，and optimized the autograd process. (#5365 )

* fused the gate and up proj in mlp

* fix code styles

* opt auto_grad

* rollback test_inference_engine.py

* modifications based on the review feedback.

* fix bugs in flash attn

* Change reshape to view

* fix test_rmsnorm_triton.py

Jianghai

7ddd8b37f0

fix (#5311 )

Jianghai

c647e00e3c

[Inference]Add fused rotary kernel and get cos cache kernel (#5302 )

* add fused rotary and get cos cache func

* staged

* fix bugs

* fix bugs

3 Commits (8fd25d6e09069a8437c6ebee8dd83e1de4c9b83d)