jiaopenglong 949a0a1d55 feat(optimizer): add layer norm to tensorboard (#429) ... * add layer norm to tensorboard * test moe layer norm * add function: reduce grads		2023-10-23 17:07:04 +08:00
..
__init__.py	feat(train): add fsdp training option (#293)	2023-10-09 18:59:31 +08:00
training_internlm.py	feat(optimizer): add layer norm to tensorboard (#429)	2023-10-23 17:07:04 +08:00
utils.py	feat(moe):support zero for expert local dp (#404)	2023-10-09 17:45:26 +08:00