jiaopenglong 949a0a1d55 feat(optimizer): add layer norm to tensorboard (#429) ... * add layer norm to tensorboard * test moe layer norm * add function: reduce grads		2023-10-23 17:07:04 +08:00
..
__init__.py	initial commit	2023-07-06 12:55:23 +08:00
checkpoint.py	initial commit	2023-07-06 12:55:23 +08:00
common.py	Merge develop to main (#233)	2023-08-24 22:03:04 +08:00
evaluation.py	feat(moe): add moe module (#182)	2023-09-27 15:54:53 +08:00
gputest.py	fix(utils): disable bench_net in gputest.py (#421)	2023-10-19 10:00:57 +08:00
logger.py	feat(utils): add timeout warpper for key functions (#286)	2023-09-07 17:26:17 +08:00
megatron_timers.py	feat: add runtime diag (#297)	2023-09-08 17:56:46 +08:00
model_checkpoint.py	compatible with old ckpt (#418)	2023-10-17 17:25:36 +08:00
parallel.py	feat(optimizer): add layer norm to tensorboard (#429)	2023-10-23 17:07:04 +08:00
registry.py	Merge develop to main (#233)	2023-08-24 22:03:04 +08:00
simple_memory_profiler.py	fix(moe): fix moe compatibility for fsdp and memory profiling (#417)	2023-10-17 14:13:48 +08:00
storage_manager.py	feat(storage): support volc oss ckpt saving (#397)	2023-10-13 03:44:29 -05:00
timeout.py	feat(moe): add moe module (#182)	2023-09-27 15:54:53 +08:00
writer.py	fix(init): allow resume_tb_folder is an empty string (#391)	2023-10-13 03:46:14 -05:00