InternLM/internlm/solver
Wenwen Qu 21624f6f81
fix(moe): remove norm&gate force sync (#448)
* add zero broadcast_sync

* delete old sync logic

* fix merged error

* refactor code

* remove some unused function (is norm/gate group)
2023-11-01 11:29:55 +08:00
..
optimizer fix(moe): remove norm&gate force sync (#448) 2023-11-01 11:29:55 +08:00
__init__.py initial commit 2023-07-06 12:55:23 +08:00
beta2_scheduler.py initial commit 2023-07-06 12:55:23 +08:00
lr_scheduler.py feat(solver): fix code to adapt to torch2.0 and provide docker images (#128) 2023-07-25 19:34:52 +08:00
pipeline_utils.py initial commit 2023-07-06 12:55:23 +08:00