Commit Graph

4 Commits (f3da80a7ca221a1ad62603d31fd808d4e8f9900f)

Author SHA1 Message Date
zhanglei b01e20adc8 update moe training cfg on real-dataset 2023-08-22 10:36:17 +08:00
zhanglei 8cdd1abb35 suppport interleaved pp 2023-08-16 12:02:59 +08:00
zhanglei 8c7d868f01 support zero_overlap_communication 2023-08-15 16:18:20 +08:00
zhanglei 1accc9f08d add no-interleaved & no-overlapped moe pp support 2023-08-14 11:10:37 +08:00