Hongxin Liu
|
27061426f7
|
[gemini] improve compatibility and add static placement policy (#4479)
* [gemini] remove distributed-related part from colotensor (#4379)
* [gemini] remove process group dependency
* [gemini] remove tp part from colo tensor
* [gemini] patch inplace op
* [gemini] fix param op hook and update tests
* [test] remove useless tests
* [test] remove useless tests
* [misc] fix requirements
* [test] fix model zoo
* [test] fix model zoo
* [test] fix model zoo
* [test] fix model zoo
* [test] fix model zoo
* [misc] update requirements
* [gemini] refactor gemini optimizer and gemini ddp (#4398)
* [gemini] update optimizer interface
* [gemini] renaming gemini optimizer
* [gemini] refactor gemini ddp class
* [example] update gemini related example
* [example] update gemini related example
* [plugin] fix gemini plugin args
* [test] update gemini ckpt tests
* [gemini] fix checkpoint io
* [example] fix opt example requirements
* [example] fix opt example
* [example] fix opt example
* [example] fix opt example
* [gemini] add static placement policy (#4443)
* [gemini] add static placement policy
* [gemini] fix param offload
* [test] update gemini tests
* [plugin] update gemini plugin
* [plugin] update gemini plugin docstr
* [misc] fix flash attn requirement
* [test] fix gemini checkpoint io test
* [example] update resnet example result (#4457)
* [example] update bert example result (#4458)
* [doc] update gemini doc (#4468)
* [example] update gemini related examples (#4473)
* [example] update gpt example
* [example] update dreambooth example
* [example] update vit
* [example] update opt
* [example] update palm
* [example] update vit and opt benchmark
* [hotfix] fix bert in model zoo (#4480)
* [hotfix] fix bert in model zoo
* [test] remove chatglm gemini test
* [test] remove sam gemini test
* [test] remove vit gemini test
* [hotfix] fix opt tutorial example (#4497)
* [hotfix] fix opt tutorial example
* [hotfix] fix opt tutorial example
|
2023-08-24 09:29:25 +08:00 |
|
Baizhou Zhang
|
4da324cd60
|
[hotfix]fix argument naming in docs and examples (#4083)
|
2023-06-26 23:50:04 +08:00 |
|
LuGY
|
160c64c645
|
[example] fix bucket size in example of gpt gemini (#4028)
|
2023-06-19 11:22:42 +08:00 |
|
digger yu
|
33eef714db
|
fix typo examples and docs (#3932)
|
2023-06-08 16:09:32 +08:00 |
|
jiangmingyan
|
5f79008c4a
|
[example] update gemini examples (#3868)
* [example]update gemini examples
* [example]update gemini examples
|
2023-05-30 18:41:41 +08:00 |
|
ver217
|
26b7aac0be
|
[zero] reorganize zero/gemini folder structure (#3424)
* [zero] refactor low-level zero folder structure
* [zero] fix legacy zero import path
* [zero] fix legacy zero import path
* [zero] remove useless import
* [zero] refactor gemini folder structure
* [zero] refactor gemini folder structure
* [zero] refactor legacy zero import path
* [zero] refactor gemini folder structure
* [zero] refactor gemini folder structure
* [zero] refactor gemini folder structure
* [zero] refactor legacy zero import path
* [zero] fix test import path
* [zero] fix test
* [zero] fix circular import
* [zero] update import
|
2023-04-04 13:48:16 +08:00 |
|
HELSON
|
6e0faa70e0
|
[gemini] add profiler in the demo (#2534)
|
2023-01-31 14:21:22 +08:00 |
|
HELSON
|
66dfcf5281
|
[gemini] update the gpt example (#2527)
|
2023-01-30 17:58:05 +08:00 |
|
HELSON
|
707b11d4a0
|
[gemini] update ddp strict mode (#2518)
* [zero] add strict ddp mode for chunk init
* [gemini] update gpt example
|
2023-01-28 14:35:25 +08:00 |
|
HELSON
|
2d1a7dfe5f
|
[zero] add strict ddp mode (#2508)
* [zero] add strict ddp mode
* [polish] add comments for strict ddp mode
* [zero] fix test error
|
2023-01-20 14:04:38 +08:00 |
|
Jiarui Fang
|
7c31706227
|
[CI] add test_ci.sh for palm, opt and gpt (#2475)
|
2023-01-16 14:44:29 +08:00 |
|
ver217
|
f525d1f528
|
[example] update gpt gemini example ci test (#2477)
|
2023-01-13 22:37:31 +08:00 |
|
Jiarui Fang
|
867c8c2d3a
|
[zero] low level optim supports ProcessGroup (#2464)
|
2023-01-13 10:05:58 +08:00 |
|
HELSON
|
d84e747975
|
[hotfix] add DISTPAN argument for benchmark (#2412)
* change the benchmark config file
* change config
* revert config file
* rename distpan to distplan
|
2023-01-10 11:39:25 +08:00 |
|
HELSON
|
498b5ca993
|
[hotfix] fix gpt gemini example (#2404)
* [hotfix] fix gpt gemini example
* [example] add new assertions
|
2023-01-09 15:52:17 +08:00 |
|
Jiarui Fang
|
1aaeb596c6
|
[example] gpt, shard init on all processes (#2366)
|
2023-01-06 15:44:50 +08:00 |
|
Jiarui Fang
|
509a87f3ff
|
[example] make gpt example directory more clear (#2353)
|
2023-01-06 11:11:26 +08:00 |