Baizhou Zhang
|
295b38fecf
|
[example] update vit example for hybrid parallel plugin (#4641)
* update vit example for hybrid plugin
* reset tp/pp size
* fix dataloader iteration bug
* update optimizer passing in evaluation/add grad_accum
* change criterion
* wrap tqdm
* change grad_accum to grad_checkpoint
* fix pbar
|
2023-09-07 17:38:45 +08:00 |
|
Hongxin Liu
|
27061426f7
|
[gemini] improve compatibility and add static placement policy (#4479)
* [gemini] remove distributed-related part from colotensor (#4379)
* [gemini] remove process group dependency
* [gemini] remove tp part from colo tensor
* [gemini] patch inplace op
* [gemini] fix param op hook and update tests
* [test] remove useless tests
* [test] remove useless tests
* [misc] fix requirements
* [test] fix model zoo
* [test] fix model zoo
* [test] fix model zoo
* [test] fix model zoo
* [test] fix model zoo
* [misc] update requirements
* [gemini] refactor gemini optimizer and gemini ddp (#4398)
* [gemini] update optimizer interface
* [gemini] renaming gemini optimizer
* [gemini] refactor gemini ddp class
* [example] update gemini related example
* [example] update gemini related example
* [plugin] fix gemini plugin args
* [test] update gemini ckpt tests
* [gemini] fix checkpoint io
* [example] fix opt example requirements
* [example] fix opt example
* [example] fix opt example
* [example] fix opt example
* [gemini] add static placement policy (#4443)
* [gemini] add static placement policy
* [gemini] fix param offload
* [test] update gemini tests
* [plugin] update gemini plugin
* [plugin] update gemini plugin docstr
* [misc] fix flash attn requirement
* [test] fix gemini checkpoint io test
* [example] update resnet example result (#4457)
* [example] update bert example result (#4458)
* [doc] update gemini doc (#4468)
* [example] update gemini related examples (#4473)
* [example] update gpt example
* [example] update dreambooth example
* [example] update vit
* [example] update opt
* [example] update palm
* [example] update vit and opt benchmark
* [hotfix] fix bert in model zoo (#4480)
* [hotfix] fix bert in model zoo
* [test] remove chatglm gemini test
* [test] remove sam gemini test
* [test] remove vit gemini test
* [hotfix] fix opt tutorial example (#4497)
* [hotfix] fix opt tutorial example
* [hotfix] fix opt tutorial example
|
2023-08-24 09:29:25 +08:00 |
|
Baizhou Zhang
|
b3ab7fbabf
|
[example] update ViT example using booster api (#3940)
|
2023-06-12 15:02:27 +08:00 |
|
Frank Lee
|
80eba05b0a
|
[test] refactor tests with spawn (#3452)
* [test] added spawn decorator
* polish code
* polish code
* polish code
* polish code
* polish code
* polish code
|
2023-04-06 14:51:35 +08:00 |
|
ver217
|
26b7aac0be
|
[zero] reorganize zero/gemini folder structure (#3424)
* [zero] refactor low-level zero folder structure
* [zero] fix legacy zero import path
* [zero] fix legacy zero import path
* [zero] remove useless import
* [zero] refactor gemini folder structure
* [zero] refactor gemini folder structure
* [zero] refactor legacy zero import path
* [zero] refactor gemini folder structure
* [zero] refactor gemini folder structure
* [zero] refactor gemini folder structure
* [zero] refactor legacy zero import path
* [zero] fix test import path
* [zero] fix test
* [zero] fix circular import
* [zero] update import
|
2023-04-04 13:48:16 +08:00 |
|
ver217
|
8e85d2440a
|
[example] update vit ci script (#2469)
* [example] update vit ci script
* [example] update requirements
* [example] update requirements
|
2023-01-13 13:31:27 +08:00 |
|
binmakeswell
|
d7352bef2c
|
[example] add example requirement (#2345)
|
2023-01-06 09:03:29 +08:00 |
|
Jiarui Fang
|
a4b4bb01d6
|
[example] update vit readme (#2155)
|
2022-12-20 15:56:54 +08:00 |
|
Jiarui Fang
|
2cfe685b9f
|
[exmaple] add vit missing functions (#2154)
|
2022-12-20 15:03:26 +08:00 |
|
Jiarui Fang
|
cf68cc92ac
|
[example] add vit (#1942)
* [ColoTensor] ColoInitContext initialize parameters in shard mode.
* polish
* [example] add vit
|
2022-11-14 17:28:03 +08:00 |