Wenwen Qu 2c5395fdfd Doc(moe): add documentation for moe training (#411) ... * add doc for moe * fix moe and zero1 check in args_sanity_check * restore moe config file		2023-10-19 10:01:12 +08:00
..
apis	initial commit	2023-07-06 12:55:23 +08:00
core	feat(train): add fsdp training option (#293)	2023-10-09 18:59:31 +08:00
data	Merge develop to main (#233)	2023-08-24 22:03:04 +08:00
initialize	Doc(moe): add documentation for moe training (#411)	2023-10-19 10:01:12 +08:00
model	Doc(moe): add documentation for moe training (#411)	2023-10-19 10:01:12 +08:00
moe	feat(moe): add moe module (#182)	2023-09-27 15:54:53 +08:00
monitor	feat(monitor): send exception to light monitor (#420)	2023-10-18 21:00:21 +08:00
solver	fix(optimizer/fsdp_optimizer.py): fsdp process empty params group (#408)	2023-10-10 20:06:04 +08:00
train	feat(train): add fsdp training option (#293)	2023-10-09 18:59:31 +08:00
utils	fix(utils): disable bench_net in gputest.py (#421)	2023-10-19 10:00:57 +08:00
__init__.py	initial commit	2023-07-06 12:55:23 +08:00