InternLM/internlm/solver
jiaopenglong 949a0a1d55
feat(optimizer): add layer norm to tensorboard (#429)
* add layer norm to tensorboard

* test moe layer norm

* add function: reduce grads
2023-10-23 17:07:04 +08:00
..
optimizer feat(optimizer): add layer norm to tensorboard (#429) 2023-10-23 17:07:04 +08:00
__init__.py initial commit 2023-07-06 12:55:23 +08:00
beta2_scheduler.py initial commit 2023-07-06 12:55:23 +08:00
lr_scheduler.py feat(solver): fix code to adapt to torch2.0 and provide docker images (#128) 2023-07-25 19:34:52 +08:00
pipeline_utils.py initial commit 2023-07-06 12:55:23 +08:00