github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
3,537 Commits
33 Branches
48 Tags
232 MiB
Commit Graph

1 Commits (102b784a10f0cd1c740d9ceba343a78166314290)

Author SHA1 Message Date
botbw 9b9b76bdcd [moe] add mixtral dp grad scaling when not all experts are activated 2024-08-01 10:06:59 +08:00