ColossalAI

Commit Graph

Author	SHA1	Message	Date
botbw	c54c4fcd15	[hotfix] moe hybrid parallelism benchmark & follow-up fix (#6048 ) * [example] pass use_fp8_comm flag to all plugins * [example] add mixtral benchmark * [moe] refine assertion and check * [moe] fix mixtral & add more tests * [moe] consider checking dp * sp group and moe_dp_group * [mixtral] remove gate tp & add more tests * [deepseek] fix tp & sp for deepseek * [mixtral] minor fix * [deepseek] add deepseek benchmark	2024-09-10 17:30:53 +08:00

Author

SHA1

Message

Date

botbw

c54c4fcd15

[hotfix] moe hybrid parallelism benchmark & follow-up fix (#6048 )

* [example] pass use_fp8_comm flag to all plugins

* [example] add mixtral benchmark

* [moe] refine assertion and check

* [moe] fix mixtral & add more tests

* [moe] consider checking dp * sp group and moe_dp_group

* [mixtral] remove gate tp & add more tests

* [deepseek] fix tp & sp for deepseek

* [mixtral] minor fix

* [deepseek] add deepseek benchmark

2024-09-10 17:30:53 +08:00

1 Commits (64f74a157ea2ad360d34ec223d1dc1ee5d379e65)