Wenwen Qu 2b863bd099 add local data parallel support for experts		2023-09-27 18:39:15 +08:00
..
__init__.py	initial commit	2023-07-06 12:55:23 +08:00
checkpoint.py	initial commit	2023-07-06 12:55:23 +08:00
common.py	Merge develop to main (#233)	2023-08-24 22:03:04 +08:00
evaluation.py	feat(moe): add moe module (#182)	2023-09-27 15:54:53 +08:00
gputest.py	Feat(PythonGC): Do garbage collection manually (#326)	2023-09-22 13:52:25 +08:00
logger.py	feat(utils): add timeout warpper for key functions (#286)	2023-09-07 17:26:17 +08:00
megatron_timers.py	feat: add runtime diag (#297)	2023-09-08 17:56:46 +08:00
model_checkpoint.py	feat(moe): add moe module (#182)	2023-09-27 15:54:53 +08:00
parallel.py	add local data parallel support for experts	2023-09-27 18:39:15 +08:00
registry.py	Merge develop to main (#233)	2023-08-24 22:03:04 +08:00
simple_memory_profiler.py	Merge develop to main (#233)	2023-08-24 22:03:04 +08:00
storage_manager.py	fix(storage): fix try_get_storage_backend (#359)	2023-09-25 15:16:25 +08:00
timeout.py	feat(moe): add moe module (#182)	2023-09-27 15:54:53 +08:00
writer.py	feat(utils/writer.py): support writer add_scalars for writing dict data (#257)	2023-09-01 13:24:46 +08:00