hxwang
|
ca674549e0
|
[chore] remove unnecessary test & changes
|
6 months ago |
genghaozhe
|
5c6c5d6be3
|
remove comments
|
6 months ago |
genghaozhe
|
df63db7e63
|
remote comments
|
6 months ago |
Hongxin Liu
|
b5f9e37c70
|
[legacy] clean up legacy code (#4743)
* [legacy] remove outdated codes of pipeline (#4692)
* [legacy] remove cli of benchmark and update optim (#4690)
* [legacy] remove cli of benchmark and update optim
* [doc] fix cli doc test
* [legacy] fix engine clip grad norm
* [legacy] remove outdated colo tensor (#4694)
* [legacy] remove outdated colo tensor
* [test] fix test import
* [legacy] move outdated zero to legacy (#4696)
* [legacy] clean up utils (#4700)
* [legacy] clean up utils
* [example] update examples
* [legacy] clean up amp
* [legacy] fix amp module
* [legacy] clean up gpc (#4742)
* [legacy] clean up context
* [legacy] clean core, constants and global vars
* [legacy] refactor initialize
* [example] fix examples ci
* [example] fix examples ci
* [legacy] fix tests
* [example] fix gpt example
* [example] fix examples ci
* [devops] fix ci installation
* [example] fix examples ci
|
1 year ago |
Hongxin Liu
|
27061426f7
|
[gemini] improve compatibility and add static placement policy (#4479)
* [gemini] remove distributed-related part from colotensor (#4379)
* [gemini] remove process group dependency
* [gemini] remove tp part from colo tensor
* [gemini] patch inplace op
* [gemini] fix param op hook and update tests
* [test] remove useless tests
* [test] remove useless tests
* [misc] fix requirements
* [test] fix model zoo
* [test] fix model zoo
* [test] fix model zoo
* [test] fix model zoo
* [test] fix model zoo
* [misc] update requirements
* [gemini] refactor gemini optimizer and gemini ddp (#4398)
* [gemini] update optimizer interface
* [gemini] renaming gemini optimizer
* [gemini] refactor gemini ddp class
* [example] update gemini related example
* [example] update gemini related example
* [plugin] fix gemini plugin args
* [test] update gemini ckpt tests
* [gemini] fix checkpoint io
* [example] fix opt example requirements
* [example] fix opt example
* [example] fix opt example
* [example] fix opt example
* [gemini] add static placement policy (#4443)
* [gemini] add static placement policy
* [gemini] fix param offload
* [test] update gemini tests
* [plugin] update gemini plugin
* [plugin] update gemini plugin docstr
* [misc] fix flash attn requirement
* [test] fix gemini checkpoint io test
* [example] update resnet example result (#4457)
* [example] update bert example result (#4458)
* [doc] update gemini doc (#4468)
* [example] update gemini related examples (#4473)
* [example] update gpt example
* [example] update dreambooth example
* [example] update vit
* [example] update opt
* [example] update palm
* [example] update vit and opt benchmark
* [hotfix] fix bert in model zoo (#4480)
* [hotfix] fix bert in model zoo
* [test] remove chatglm gemini test
* [test] remove sam gemini test
* [test] remove vit gemini test
* [hotfix] fix opt tutorial example (#4497)
* [hotfix] fix opt tutorial example
* [hotfix] fix opt tutorial example
|
1 year ago |
HELSON
|
66dfcf5281
|
[gemini] update the gpt example (#2527)
|
2 years ago |
Jiarui Fang
|
7c31706227
|
[CI] add test_ci.sh for palm, opt and gpt (#2475)
|
2 years ago |
HELSON
|
d84e747975
|
[hotfix] add DISTPAN argument for benchmark (#2412)
* change the benchmark config file
* change config
* revert config file
* rename distpan to distplan
|
2 years ago |
Jiarui Fang
|
509a87f3ff
|
[example] make gpt example directory more clear (#2353)
|
2 years ago |
HELSON
|
e00cedd181
|
[example] update gemini benchmark bash (#2306)
|
2 years ago |
Jiarui Fang
|
879df8b943
|
[example] GPT polish readme (#2274)
|
2 years ago |
HELSON
|
09c0102fe6
|
[example] fix gpt example with 0.1.10 (#2265)
|
2 years ago |
HELSON
|
31fe84237b
|
[example] fix benchmark.sh for gpt example (#2229)
|
2 years ago |
Jiarui Fang
|
49c601da21
|
[example] add benchmark.sh for gpt (#2226)
|
2 years ago |
HELSON
|
3629e611cd
|
[example] update gpt benchmark (#2219)
|
2 years ago |
Jiarui Fang
|
7675792100
|
[builder] raise Error when CUDA_HOME is not set (#2213)
|
2 years ago |
Jiarui Fang
|
d5e3e3ec01
|
[example] update gpt example for larger model scale (#2211)
|
2 years ago |
Jiarui Fang
|
29868a9ec1
|
[example] update gpt readme with performance (#2206)
|
2 years ago |
HELSON
|
a7d95b7024
|
[example] add zero1, zero2 example in GPT examples (#2146)
* [example] add zero1 and zero2 for GPT
* update readme in gpt example
* polish code
* change init value
* update readme
|
2 years ago |
Jiarui Fang
|
60abd86d6a
|
[example] enhance GPT demo (#1959)
* [example] enhence GPT demo
* Update README.md
Co-authored-by: binmakeswell <binmakeswell@gmail.com>
|
2 years ago |
Jiarui Fang
|
a25f755331
|
[example] add TP to GPT example (#1828)
|
2 years ago |
Jiarui Fang
|
b1263d32ba
|
[example] simplify the GPT2 huggingface example (#1826)
|
2 years ago |
Jiarui Fang
|
203ca57aed
|
[example] add GPT
|
2 years ago |