Super Daniel
c198c7c0b0
[hotfix] meta tensor default device. ( #2510 )
2 years ago
HELSON
077a5cdde4
[zero] fix gradient clipping in hybrid parallelism ( #2521 )
...
* [zero] fix gradient clipping in hybrid parallelism
* [testing] change model name to avoid pytest warning
* [hotfix] fix unit testing
2 years ago
Jiarui Fang
fd8d19a6e7
[example] update lightning dependency for stable diffusion ( #2522 )
2 years ago
YuliangLiu0306
aa0f6686f9
[autoparallel] accelerate gpt2 training ( #2495 )
2 years ago
binmakeswell
a360b9bc44
[doc] update example link ( #2520 )
...
* [doc] update example link
* [doc] update example link
2 years ago
HELSON
707b11d4a0
[gemini] update ddp strict mode ( #2518 )
...
* [zero] add strict ddp mode for chunk init
* [gemini] update gpt example
2 years ago
Frank Lee
0af793836c
[workflow] fixed changed file detection ( #2515 )
2 years ago
binmakeswell
a6a10616ec
[doc] update opt and tutorial links ( #2509 )
2 years ago
HELSON
2d1a7dfe5f
[zero] add strict ddp mode ( #2508 )
...
* [zero] add strict ddp mode
* [polish] add comments for strict ddp mode
* [zero] fix test error
2 years ago
oahzxl
c04f183237
[autochunk] support parsing blocks ( #2506 )
2 years ago
Super Daniel
35c0c0006e
[utils] lazy init. ( #2148 )
...
* [utils] lazy init.
* [utils] remove description.
* [utils] complete.
* [utils] finalize.
* [utils] fix names.
2 years ago
oahzxl
72341e65f4
[auto-chunk] support extramsa ( #3 ) ( #2504 )
2 years ago
Ziyue Jiang
0f02b8c6e6
add avg partition ( #2483 )
...
Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>
2 years ago
アマデウス
99d9713b02
Revert "Update parallel_context.py ( #2408 )"
...
This reverts commit 7d5640b9db
.
2 years ago
oahzxl
ecccc91f21
[autochunk] support autochunk on evoformer ( #2497 )
2 years ago
Fazzie-Maqianli
304f1ba124
Merge pull request #2499 from feifeibear/dev0116_10
...
[example] check dreambooth example gradient accmulation must be 1
2 years ago
jiaruifang
32390cbe8f
add test_ci.sh to dreambooth
2 years ago
jiaruifang
7f822a5c45
Merge branch 'main' of https://github.com/hpcaitech/ColossalAI into dev0116
2 years ago
jiaruifang
025b482dc1
[example] dreambooth example
2 years ago
oahzxl
5db3a5bf42
[fx] allow control of ckpt_codegen init ( #2498 )
...
* [fx] allow control of ckpt_codegen init
Currently in ColoGraphModule, ActivationCheckpointCodeGen will be set automatically in __init__. But other codegen can't be set if so.
So I add an arg to control whether to set ActivationCheckpointCodeGen in __init__.
* code style
2 years ago
Jiarui Fang
e327e95144
[hotfix] gpt example titans bug #2493 ( #2494 )
2 years ago
jiaruifang
e58cc441e2
polish code and fix dataloader bugs
2 years ago
jiaruifang
a4b75b78a0
[hotfix] gpt example titans bug #2493
2 years ago
jiaruifang
8208fd023a
Merge branch 'main' of https://github.com/hpcaitech/ColossalAI into dev0116
2 years ago
HELSON
d565a24849
[zero] add unit testings for hybrid parallelism ( #2486 )
2 years ago
binmakeswell
fcc6d61d92
[example] fix requirements ( #2488 )
2 years ago
oahzxl
4953b4ace1
[autochunk] support evoformer tracer ( #2485 )
...
support full evoformer tracer, which is a main module of alphafold. previously we just support a simplifed version of it.
1. support some evoformer's op in fx
2. support evoformer test
3. add repos for test code
2 years ago
YuliangLiu0306
67e1912b59
[autoparallel] support origin activation ckpt on autoprallel system ( #2468 )
2 years ago
Jiarui Fang
3a21485ead
[example] titans for gpt ( #2484 )
2 years ago
jiaruifang
438ea608f3
update readme
2 years ago
jiaruifang
38424db6ff
polish code
2 years ago
jiaruifang
92f65fbbe3
remove license
2 years ago
jiaruifang
315e1433ce
polish readme
2 years ago
jiaruifang
37baea20cb
[example] titans for gpt
2 years ago
jiaruifang
236b4195ff
Merge branch 'main' of https://github.com/hpcaitech/ColossalAI into dev0116
2 years ago
jiaruifang
e64a05b38b
polish code
2 years ago
Jiarui Fang
7c31706227
[CI] add test_ci.sh for palm, opt and gpt ( #2475 )
2 years ago
Jiarui Fang
e4c38ba367
[example] stable diffusion add roadmap ( #2482 )
2 years ago
jiaruifang
9cba38b492
add dummy test_ci.sh
2 years ago
jiaruifang
f78bad21ed
[example] stable diffusion add roadmap
2 years ago
Frank Lee
579dba572f
[workflow] fixed the skip condition of example weekly check workflow ( #2481 )
2 years ago
HELSON
21c88220ce
[zero] add unit test for low-level zero init ( #2474 )
2 years ago
ver217
f525d1f528
[example] update gpt gemini example ci test ( #2477 )
2 years ago
Ziyue Jiang
fef5c949c3
polish pp middleware ( #2476 )
...
Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>
2 years ago
HELSON
a5dc4253c6
[zero] polish low level optimizer ( #2473 )
2 years ago
Frank Lee
8b7495dd54
[example] integrate seq-parallel tutorial with CI ( #2463 )
2 years ago
ver217
8e85d2440a
[example] update vit ci script ( #2469 )
...
* [example] update vit ci script
* [example] update requirements
* [example] update requirements
2 years ago
Jiarui Fang
867c8c2d3a
[zero] low level optim supports ProcessGroup ( #2464 )
2 years ago
Frank Lee
e6943e2d11
[example] integrate autoparallel demo with CI ( #2466 )
...
* [example] integrate autoparallel demo with CI
* polish code
* polish code
* polish code
* polish code
2 years ago
Frank Lee
14d9299360
[cli] fixed hostname mismatch error ( #2465 )
2 years ago