Hongxin Liu
|
079bf3cb26
|
[misc] update pre-commit and run all files (#4752)
* [misc] update pre-commit
* [misc] run pre-commit
* [misc] remove useless configuration files
* [misc] ignore cuda for clang-format
|
2023-09-19 14:20:26 +08:00 |
|
Baizhou Zhang
|
660eed9124
|
[pipeline] set optimizer to optional in execute_pipeline (#4630)
* set optimizer to optional in execute_pipeline
* arrange device and mixed precision in booster init
* fix execute_pipeline in booster.py
|
2023-09-07 10:42:59 +08:00 |
|
Hongxin Liu
|
508ca36fe3
|
[pipeline] 1f1b schedule receive microbatch size (#4589)
|
2023-09-01 21:45:14 +08:00 |
|
LuGY
|
a78daf6180
|
[shardformer] support interleaved pipeline (#4448)
* support interleaved pipeline
* fix unit test
* remove virtual stage test in stage mgr
* add droped type hint and updated bwd
|
2023-08-16 19:29:03 +08:00 |
|
LuGY
|
d3c6cd66f3
|
[pipeline] add unit test for 1f1b (#4303)
* add unit test for 1f1b
* polish code
* polish code and update ut version
* fix
|
2023-08-15 23:25:14 +08:00 |
|
Hongxin Liu
|
f51ce1bc8e
|
[pipeline] refactor 1f1b schedule (#4115)
* [api] update optimizer wrapper to fit pipeline
* [pipeline] add base schedule
* [pipeline] add 1f1b schedule
* [test] add pipeline schedule utils test
* [pipeline] fix import
|
2023-08-15 23:25:14 +08:00 |