Baizhou Zhang
|
295b38fecf
|
[example] update vit example for hybrid parallel plugin (#4641)
* update vit example for hybrid plugin
* reset tp/pp size
* fix dataloader iteration bug
* update optimizer passing in evaluation/add grad_accum
* change criterion
* wrap tqdm
* change grad_accum to grad_checkpoint
* fix pbar
|
2023-09-07 17:38:45 +08:00 |
Baizhou Zhang
|
b3ab7fbabf
|
[example] update ViT example using booster api (#3940)
|
2023-06-12 15:02:27 +08:00 |
Jiarui Fang
|
a4b4bb01d6
|
[example] update vit readme (#2155)
|
2022-12-20 15:56:54 +08:00 |
Jiarui Fang
|
cf68cc92ac
|
[example] add vit (#1942)
* [ColoTensor] ColoInitContext initialize parameters in shard mode.
* polish
* [example] add vit
|
2022-11-14 17:28:03 +08:00 |