HELSON f7f2248771 [moe] fix MoE bugs (#1628) ... * remove forced FP32 modules * correct no_shard-contexts' positions		2022-09-22 13:56:30 +08:00
..
__init__.py	[MOE] support PR-MOE (#488)	2022-03-22 16:48:22 +08:00
_operation.py	[MOE] polish moe_env (#467)	2022-03-19 15:36:25 +08:00
experts.py	[moe] fix MoE bugs (#1628)	2022-09-22 13:56:30 +08:00
layers.py	[moe] fix MoE bugs (#1628)	2022-09-22 13:56:30 +08:00
utils.py	[gemini] add GeminiMemoryManger (#832)	2022-04-24 13:08:48 +08:00