InternLM/internlm
yingtongxiong 1bc3c33b75 change the order of dp and sp all-reduce 2023-10-25 13:27:47 +08:00
..
apis initial commit 2023-07-06 12:55:23 +08:00
core fix all-reduce norm grad 2023-10-25 13:11:59 +08:00
data Merge develop to main (#233) 2023-08-24 22:03:04 +08:00
initialize Doc(moe): add documentation for moe training (#411) 2023-10-19 10:01:12 +08:00
model fix all-reduce norm grad 2023-10-25 13:11:59 +08:00
moe feat(moe): add moe module (#182) 2023-09-27 15:54:53 +08:00
monitor feat(monitor): send exception to light monitor (#420) 2023-10-18 21:00:21 +08:00
solver change the order of dp and sp all-reduce 2023-10-25 13:27:47 +08:00
train feat(optimizer): add layer norm to tensorboard (#429) 2023-10-23 17:07:04 +08:00
utils feat(optimizer): add layer norm to tensorboard (#429) 2023-10-23 17:07:04 +08:00
__init__.py initial commit 2023-07-06 12:55:23 +08:00