InternLM/internlm
Wenwen Qu 21624f6f81
fix(moe): remove norm&gate force sync (#448)
* add zero broadcast_sync

* delete old sync logic

* fix merged error

* refactor code

* remove some unused function (is norm/gate group)
2023-11-01 11:29:55 +08:00
..
apis initial commit 2023-07-06 12:55:23 +08:00
core volc_path (#454) 2023-10-27 18:53:06 +08:00
data Merge develop to main (#233) 2023-08-24 22:03:04 +08:00
initialize fix(moe): remove norm&gate force sync (#448) 2023-11-01 11:29:55 +08:00
model fix(moe): remove norm&gate force sync (#448) 2023-11-01 11:29:55 +08:00
moe fix(moe): remove norm&gate force sync (#448) 2023-11-01 11:29:55 +08:00
monitor feat(monitor): send exception to light monitor (#420) 2023-10-18 21:00:21 +08:00
solver fix(moe): remove norm&gate force sync (#448) 2023-11-01 11:29:55 +08:00
train fix(moe): remove norm&gate force sync (#448) 2023-11-01 11:29:55 +08:00
utils fix(os): fix FileNotFoundError in storage_manager (#455) 2023-10-27 22:32:46 +08:00
__init__.py initial commit 2023-07-06 12:55:23 +08:00