Xuanlei Zhao
|
f71e63b0f3
|
[moe] support optimizer checkpoint (#5015)
* Refactor MoE Manager setup method
* unshard optim ckpt
* optim io
* update transformer version
* update requirements
* update ckpt
* update ckpt
* update ckpt
* fix engine
* fix engine
|
2023-11-08 15:07:03 +00:00 |
|
Xuanlei Zhao
|
dc003c304c
|
[moe] merge moe into main (#4978)
* update moe module
* support openmoe
|
2023-11-02 02:21:24 +00:00 |
|
Hongxin Liu
|
079bf3cb26
|
[misc] update pre-commit and run all files (#4752)
* [misc] update pre-commit
* [misc] run pre-commit
* [misc] remove useless configuration files
* [misc] ignore cuda for clang-format
|
2023-09-19 14:20:26 +08:00 |
|
Frank Lee
|
80eba05b0a
|
[test] refactor tests with spawn (#3452)
* [test] added spawn decorator
* polish code
* polish code
* polish code
* polish code
* polish code
* polish code
|
2023-04-06 14:51:35 +08:00 |
|
ver217
|
933048ad3e
|
[test] reorganize zero/gemini tests (#3445)
|
2023-04-06 09:38:25 +08:00 |
|
ver217
|
26b7aac0be
|
[zero] reorganize zero/gemini folder structure (#3424)
* [zero] refactor low-level zero folder structure
* [zero] fix legacy zero import path
* [zero] fix legacy zero import path
* [zero] remove useless import
* [zero] refactor gemini folder structure
* [zero] refactor gemini folder structure
* [zero] refactor legacy zero import path
* [zero] refactor gemini folder structure
* [zero] refactor gemini folder structure
* [zero] refactor gemini folder structure
* [zero] refactor legacy zero import path
* [zero] fix test import path
* [zero] fix test
* [zero] fix circular import
* [zero] update import
|
2023-04-04 13:48:16 +08:00 |
|
HELSON
|
1a1d68b053
|
[moe] add checkpoint for moe models (#3354)
* [moe] add checkpoint for moe models
* [hotfix] fix bugs in unit test
|
2023-03-31 09:20:33 +08:00 |