You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

HELSON bccbc15861 [MOE] changed parallelmode to dist process group (#460)		3 years ago
..
amp	[hotfix] fix initialize bug with zero (#442)	3 years ago
builder	add pytorch hooks (#179)	3 years ago
communication	fix format (#332)	3 years ago
context	add moe context, moe utilities and refactor gradient handler (#455)	3 years ago
engine	add moe context, moe utilities and refactor gradient handler (#455)	3 years ago
kernel	[formart] format fixed for kernel\cuda_native codes (#335)	3 years ago
logging	[log] better logging display with rich (#426)	3 years ago
nn	[MOE] changed parallelmode to dist process group (#460)	3 years ago
registry	add pytorch hooks (#179)	3 years ago
testing	optimized context test time consumption (#446)	3 years ago
trainer	Added profiler communication operations	3 years ago
utils	add moe context, moe utilities and refactor gradient handler (#455)	3 years ago
zero	[doc] Update docstring for ZeRO (#459)	3 years ago
__init__.py	Develop/experiments (#59)	3 years ago
constants.py	fix format constants.py (#358)	3 years ago
core.py	add moe context, moe utilities and refactor gradient handler (#455)	3 years ago
global_variables.py	Optimized MoE layer and fixed some bugs;	3 years ago
initialize.py	[zero] Update initialize for ZeRO (#458)	3 years ago