Xuanlei Zhao f71e63b0f3 [moe] support optimizer checkpoint (#5015) ... * Refactor MoE Manager setup method * unshard optim ckpt * optim io * update transformer version * update requirements * update ckpt * update ckpt * update ckpt * fix engine * fix engine		2023-11-08 15:07:03 +00:00
..
d_tensor	[hotfix] Fix the bug where process groups were not being properly released. (#4940)	2023-10-31 14:47:30 +08:00
moe_tensor	[moe] support optimizer checkpoint (#5015)	2023-11-08 15:07:03 +00:00
__init__.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
colo_parameter.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
colo_tensor.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
comm_spec.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
param_op_hook.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
shape_consistency.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
sharding_spec.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
utils.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00