Hongxin Liu
|
261eab02fb
|
[plugin] add 3d parallel plugin (#4295)
* [amp] add mixed precision optimizer
* [plugin] add 3d parallel plugin
* [booster] support pipeline
* [plugin] 3d parallel plugin support clip grad norm
* [shardformer] fix sharder and add plugin test
* [plugin] rename 3d parallel plugin
* [ci] support testmon core pkg change detection (#4305)
* [hotfix] debug testmon
* [hotfix] fix llama
* [hotfix] fix p2p bugs
* [hotfix] fix requirements
|
2023-08-15 23:25:14 +08:00 |
|
wukong1992
|
b37797ed3d
|
[booster] support torch fsdp plugin in booster (#3697)
Co-authored-by: 纪少敏 <jishaomin@jishaomindeMBP.lan>
|
2023-05-15 12:14:38 +08:00 |
|
Hongxin Liu
|
4b3240cb59
|
[booster] add low level zero plugin (#3594)
* [booster] add low level zero plugin
* [booster] fix gemini plugin test
* [booster] fix precision
* [booster] add low level zero plugin test
* [test] fix booster plugin test oom
* [test] fix booster plugin test oom
* [test] fix googlenet and inception output trans
* [test] fix diffuser clip vision model
* [test] fix torchaudio_wav2vec2_base
* [test] fix low level zero plugin test
|
2023-04-26 14:37:25 +08:00 |
|
ver217
|
5f2e34e6c9
|
[booster] implement Gemini plugin (#3352)
* [booster] add gemini plugin
* [booster] update docstr
* [booster] gemini plugin add coloparam convertor
* [booster] fix coloparam convertor
* [booster] fix gemini plugin device
* [booster] add gemini plugin test
* [booster] gemini plugin ignore sync bn
* [booster] skip some model
* [booster] skip some model
* [booster] modify test world size
* [booster] modify test world size
* [booster] skip test
|
2023-03-31 16:06:13 +08:00 |
|
Frank Lee
|
e7f3bed2d3
|
[booster] added the plugin base and torch ddp plugin (#3180)
* [booster] added the plugin base and torch ddp plugin
* polish code
* polish code
* polish code
|
2023-03-21 17:39:30 +08:00 |