Commit Graph

1 Commits (229382c84437689dec243557e40bdd8a5a659ef7)

Author SHA1 Message Date
HELSON e6d50ec107
[zero] adapt zero for unsharded parameters (#561)
* support existing sharded and unsharded parameters in zero

* add unitest for moe-zero model init

* polish moe gradient handler
2022-03-31 18:34:11 +08:00