Hongxin Liu
|
d202cc28c0
|
[npu] change device to accelerator api (#5239)
* update accelerator
* fix timer
* fix amp
* update
* fix
* update bug
* add error raise
* fix autocast
* fix set device
* remove doc accelerator
* update doc
* update doc
* update doc
* use nullcontext
* update cpu
* update null context
* change time limit for example
* udpate
* update
* update
* update
* [npu] polish accelerator code
---------
Co-authored-by: Xuanlei Zhao <xuanlei.zhao@gmail.com>
Co-authored-by: zxl <43881818+oahzxl@users.noreply.github.com>
|
11 months ago |
|
Blagoy Simandoff
|
8aed02b957
|
[nfc] fix minor typo in README (#4846)
|
1 year ago |
|
Baizhou Zhang
|
df66741f77
|
[bug] fix get_default_parser in examples (#4764)
|
1 year ago |
|
Hongxin Liu
|
079bf3cb26
|
[misc] update pre-commit and run all files (#4752)
* [misc] update pre-commit
* [misc] run pre-commit
* [misc] remove useless configuration files
* [misc] ignore cuda for clang-format
|
1 year ago |
|
Hongxin Liu
|
27061426f7
|
[gemini] improve compatibility and add static placement policy (#4479)
* [gemini] remove distributed-related part from colotensor (#4379)
* [gemini] remove process group dependency
* [gemini] remove tp part from colo tensor
* [gemini] patch inplace op
* [gemini] fix param op hook and update tests
* [test] remove useless tests
* [test] remove useless tests
* [misc] fix requirements
* [test] fix model zoo
* [test] fix model zoo
* [test] fix model zoo
* [test] fix model zoo
* [test] fix model zoo
* [misc] update requirements
* [gemini] refactor gemini optimizer and gemini ddp (#4398)
* [gemini] update optimizer interface
* [gemini] renaming gemini optimizer
* [gemini] refactor gemini ddp class
* [example] update gemini related example
* [example] update gemini related example
* [plugin] fix gemini plugin args
* [test] update gemini ckpt tests
* [gemini] fix checkpoint io
* [example] fix opt example requirements
* [example] fix opt example
* [example] fix opt example
* [example] fix opt example
* [gemini] add static placement policy (#4443)
* [gemini] add static placement policy
* [gemini] fix param offload
* [test] update gemini tests
* [plugin] update gemini plugin
* [plugin] update gemini plugin docstr
* [misc] fix flash attn requirement
* [test] fix gemini checkpoint io test
* [example] update resnet example result (#4457)
* [example] update bert example result (#4458)
* [doc] update gemini doc (#4468)
* [example] update gemini related examples (#4473)
* [example] update gpt example
* [example] update dreambooth example
* [example] update vit
* [example] update opt
* [example] update palm
* [example] update vit and opt benchmark
* [hotfix] fix bert in model zoo (#4480)
* [hotfix] fix bert in model zoo
* [test] remove chatglm gemini test
* [test] remove sam gemini test
* [test] remove vit gemini test
* [hotfix] fix opt tutorial example (#4497)
* [hotfix] fix opt tutorial example
* [hotfix] fix opt tutorial example
|
1 year ago |
|
digger yu
|
33eef714db
|
fix typo examples and docs (#3932)
|
1 year ago |
|
Liu Ziming
|
b306cecf28
|
[example] Modify palm example with the new booster API (#3913)
* Modify torch version requirement to adapt torch 2.0
* modify palm example using new booster API
* roll back
* fix port
* polish
* polish
|
1 year ago |
|
digger yu
|
518b31c059
|
[docs] change placememt_policy to placement_policy (#3829)
* fix typo colossalai/autochunk auto_parallel amp
* fix typo colossalai/auto_parallel nn utils etc.
* fix typo colossalai/auto_parallel autochunk fx/passes etc.
* fix typo docs/
* change placememt_policy to placement_policy in docs/ and examples/
|
2 years ago |
|
ver217
|
26b7aac0be
|
[zero] reorganize zero/gemini folder structure (#3424)
* [zero] refactor low-level zero folder structure
* [zero] fix legacy zero import path
* [zero] fix legacy zero import path
* [zero] remove useless import
* [zero] refactor gemini folder structure
* [zero] refactor gemini folder structure
* [zero] refactor legacy zero import path
* [zero] refactor gemini folder structure
* [zero] refactor gemini folder structure
* [zero] refactor gemini folder structure
* [zero] refactor legacy zero import path
* [zero] fix test import path
* [zero] fix test
* [zero] fix circular import
* [zero] update import
|
2 years ago |
|
Jiarui Fang
|
3a21485ead
|
[example] titans for gpt (#2484)
|
2 years ago |
|
Jiarui Fang
|
7c31706227
|
[CI] add test_ci.sh for palm, opt and gpt (#2475)
|
2 years ago |
|
ZijianYY
|
fe0f7970a2
|
[examples] adding tflops to PaLM (#2365)
|
2 years ago |
|
binmakeswell
|
d7352bef2c
|
[example] add example requirement (#2345)
|
2 years ago |
|
ZijianYY
|
f7fd592bf4
|
[examples]adding tp to PaLM (#2319)
|
2 years ago |
|
ZijianYY
|
df1d6dc553
|
[examples] using args and combining two versions for PaLM (#2284)
|
2 years ago |
|
Jiarui Fang
|
2cdecc9f38
|
[example] make palm + GeminiDPP work (#2227)
|
2 years ago |
|
ZijianYY
|
63cc77173b
|
[example] Palm adding gemini, still has bugs (#2221)
|
2 years ago |
|
ZijianYY
|
92de90dfb3
|
[examples] replace einsum with matmul (#2210)
|
2 years ago |
|
Jiarui Fang
|
27327a4c90
|
[example] add palm pytorch version (#2172)
|
2 years ago |
