ColossalAI/examples/language
Xuanlei Zhao f71e63b0f3
[moe] support optimizer checkpoint (#5015)
* Refactor MoE Manager setup method

* unshard optim ckpt

* optim io

* update transformer version

* update requirements

* update ckpt

* update ckpt

* update ckpt

* fix engine

* fix engine
2023-11-08 15:07:03 +00:00
..
bert [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
commons [example] make gpt example directory more clear (#2353) 2023-01-06 11:11:26 +08:00
gpt [bug] fix get_default_parser in examples (#4764) 2023-09-21 10:42:25 +08:00
llama2 [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
openmoe [moe] support optimizer checkpoint (#5015) 2023-11-08 15:07:03 +00:00
opt [bug] fix get_default_parser in examples (#4764) 2023-09-21 10:42:25 +08:00
palm [nfc] fix minor typo in README (#4846) 2023-10-07 17:51:11 +08:00