Hongxin Liu
|
152239bbfa
|
[gemini] gemini supports lazy init (#3379)
* [gemini] fix nvme optimizer init
* [gemini] gemini supports lazy init
* [gemini] add init example
* [gemini] add fool model
* [zero] update gemini ddp
* [zero] update init example
* add chunk method
* add chunk method
* [lazyinit] fix lazy tensor tolist
* [gemini] fix buffer materialization
* [misc] remove useless file
* [booster] update gemini plugin
* [test] update gemini plugin test
* [test] fix gemini plugin test
* [gemini] fix import
* [gemini] fix import
* [lazyinit] use new metatensor
* [lazyinit] use new metatensor
* [lazyinit] fix __set__ method
|
2023-04-12 16:03:25 +08:00 |
|
Frank Lee
|
7d8d825681
|
[booster] fixed the torch ddp plugin with the new checkpoint api (#3442)
|
2023-04-06 09:43:51 +08:00 |
|
Frank Lee
|
1beb85cc25
|
[checkpoint] refactored the API and added safetensors support (#3427)
* [checkpoint] refactored the API and added safetensors support
* polish code
|
2023-04-04 15:23:01 +08:00 |
|
ver217
|
26b7aac0be
|
[zero] reorganize zero/gemini folder structure (#3424)
* [zero] refactor low-level zero folder structure
* [zero] fix legacy zero import path
* [zero] fix legacy zero import path
* [zero] remove useless import
* [zero] refactor gemini folder structure
* [zero] refactor gemini folder structure
* [zero] refactor legacy zero import path
* [zero] refactor gemini folder structure
* [zero] refactor gemini folder structure
* [zero] refactor gemini folder structure
* [zero] refactor legacy zero import path
* [zero] fix test import path
* [zero] fix test
* [zero] fix circular import
* [zero] update import
|
2023-04-04 13:48:16 +08:00 |
|
ver217
|
5f2e34e6c9
|
[booster] implement Gemini plugin (#3352)
* [booster] add gemini plugin
* [booster] update docstr
* [booster] gemini plugin add coloparam convertor
* [booster] fix coloparam convertor
* [booster] fix gemini plugin device
* [booster] add gemini plugin test
* [booster] gemini plugin ignore sync bn
* [booster] skip some model
* [booster] skip some model
* [booster] modify test world size
* [booster] modify test world size
* [booster] skip test
|
2023-03-31 16:06:13 +08:00 |
|
Frank Lee
|
73d3e4d309
|
[booster] implemented the torch ddd + resnet example (#3232)
* [booster] implemented the torch ddd + resnet example
* polish code
|
2023-03-27 10:24:14 +08:00 |
|
Frank Lee
|
e7f3bed2d3
|
[booster] added the plugin base and torch ddp plugin (#3180)
* [booster] added the plugin base and torch ddp plugin
* polish code
* polish code
* polish code
|
2023-03-21 17:39:30 +08:00 |
|
Frank Lee
|
a9b8402d93
|
[booster] added the accelerator implementation (#3159)
|
2023-03-20 13:59:24 +08:00 |
|
Frank Lee
|
ed19290560
|
[booster] implemented mixed precision class (#3151)
* [booster] implemented mixed precision class
* polish code
|
2023-03-17 11:00:15 +08:00 |
|
Frank Lee
|
f19b49e164
|
[booster] init module structure and definition (#3056)
|
2023-03-09 11:27:46 +08:00 |