HELSON
|
31fe84237b
|
[example] fix benchmark.sh for gpt example (#2229)
|
2 years ago |
Super Daniel
|
78483a9fdd
|
[logger] hotfix, missing _FORMAT (#2231)
|
2 years ago |
oahzxl
|
f5515e9978
|
use max_mem to control stratge
|
2 years ago |
oahzxl
|
f7d8092c84
|
align openfold
|
2 years ago |
oahzxl
|
5c4df01af3
|
update openfold
|
2 years ago |
oahzxl
|
289f3a45c2
|
init openfold
|
2 years ago |
oahzxl
|
efe6fe3a33
|
code style
|
2 years ago |
oahzxl
|
7a23deb584
|
code style
|
2 years ago |
oahzxl
|
5a916c0adb
|
add print
|
2 years ago |
oahzxl
|
1d7ca02301
|
add benchmark
|
2 years ago |
Jiarui Fang
|
2cdecc9f38
|
[example] make palm + GeminiDPP work (#2227)
|
2 years ago |
ZijianYY
|
63cc77173b
|
[example] Palm adding gemini, still has bugs (#2221)
|
2 years ago |
HELSON
|
7010e18134
|
[example] update gpt example (#2225)
|
2 years ago |
Jiarui Fang
|
49c601da21
|
[example] add benchmark.sh for gpt (#2226)
|
2 years ago |
oahzxl
|
fff493c202
|
init openfold
|
2 years ago |
oahzxl
|
69af93107f
|
add evoformer openfold init
|
2 years ago |
HELSON
|
3629e611cd
|
[example] update gpt benchmark (#2219)
|
2 years ago |
Jiarui Fang
|
54de05da5d
|
[builder] polish builder with better base class (#2216)
* [builder] polish builder
* remove print
|
2 years ago |
YuliangLiu0306
|
3b1b91eaf4
|
[autoparallel] record parameter attribute in colotracer (#2217)
* [autoparallel] record parameter attribute in collotracer
* [autoparallel] fix construct_meta_info bug
|
2 years ago |
ZijianYY
|
92de90dfb3
|
[examples] replace einsum with matmul (#2210)
|
2 years ago |
Jiarui Fang
|
7675792100
|
[builder] raise Error when CUDA_HOME is not set (#2213)
|
2 years ago |
HELSON
|
78a89d9b41
|
[diffusion] update readme (#2214)
|
2 years ago |
Jiarui Fang
|
d96cc37e32
|
[example] update GPT example benchmark results (#2212)
|
2 years ago |
Jiarui Fang
|
d5e3e3ec01
|
[example] update gpt example for larger model scale (#2211)
|
2 years ago |
Boyuan Yao
|
24246f7aa5
|
[autoparallel] Attach input, buffer and output tensor to MetaInfo class (#2162)
* [fx] metainfo class for auto parallel
* [fx] add unit test for linear metainfo
* [fx] fix bwd param for linear
* [fx] modify unit test
* [fx] modify unit test
* [fx] modify import
* [fx] modify import
* [fx] modify import
* [fx] move meta profiler to auto parallel
* [fx] add conv metainfo class
* [fx] restore profiler
* [fx] restore meta profiler
* [autoparallel] modify unit test
* [fx] modify unit test
* [autoparallel] add batchnorm metainfo class
* [autoparallel] fix batchnorm unit test function declaration
* [fx] restore profiler
* [fx] add relu metainfo class
* [fx] restore profiler
* [autoparallel] modify metainfo input
* [autoparallel] add pooling metainfo
* [autoparallel] add F.linear metainfo generator
* [autoparallel] add binary elementwise metainfo
* [fx] recover profiler
* [autoparallel] fix forward memory calculation
* [autoparallel] modify constants.py
* [autoparallel] remove redundant print
* [autoparallel] add F.conv metainfo
* [autoparallel] linear fix
* [autoparallel] memory estimation for communication actions
* [autoparallel] fix docstring
* [autoparallel] fix variables name
* [autoparallel] attach tensor to metainfo class
* [autoparallel] fix dangerous try except
* [autoparallel] attach memory cost to shape consistency node
* [autoparallel] attach shape consistency node's metainfo to the node
* [autoparallel] remove todo in shape consistency memory estimation
* [autoparallel] fix the annotation
|
2 years ago |
Boyuan Yao
|
d0bc5a1b34
|
[autoparallel] new metainfoprop based on metainfo class (#2179)
* [autoparallel] new metainfoprop to combine SPMD solver and checkpoint solver
* [autoparallel] new metainfoprop to combine SPMD solver and checkpoint solver
* [autoparallel] modify placeholder handler
* [autoparallel] modify metainfoprop
* [autoparallel] fix function typo
* [autoparallel] fix placeholder handler
|
2 years ago |
YuliangLiu0306
|
78509124d3
|
[autoparallel] update getitem handler (#2207)
|
2 years ago |
Jiarui Fang
|
29868a9ec1
|
[example] update gpt readme with performance (#2206)
|
2 years ago |
Jiarui Fang
|
1cb532ffec
|
[builder] multihead attn runtime building (#2203)
* [hotfix] correcnt cpu_optim runtime compilation
* [builder] multihead attn
* fix bug
* fix a bug
|
2 years ago |
oahzxl
|
cb2dd1a106
|
turn off print mem
|
2 years ago |
oahzxl
|
a2b4755ce9
|
code style
|
2 years ago |
oahzxl
|
6be89a3b82
|
add chunksize in emit, fix bug in reassgin shape
|
2 years ago |
Tongping Liu
|
8e22c38b89
|
[hotfix] Fixing the bug related to ipv6 support
Co-authored-by: ByteDance <tongping.liu@bytedance.com>
|
2 years ago |
ziyuhuang123
|
ac85a18043
|
[example] polish doc (#2201)
|
2 years ago |
oahzxl
|
378a49dc6c
|
code style
|
2 years ago |
oahzxl
|
8f5a0edfab
|
add chunk select
|
2 years ago |
YuliangLiu0306
|
4851f2d607
|
[autoparallel] update_getattr_handler (#2193)
|
2 years ago |
YuliangLiu0306
|
f10ce01e31
|
[autoparallel] add gpt2 performance test code (#2194)
|
2 years ago |
HELSON
|
a3100bd50d
|
[testing] add beit model for unit testings (#2196)
* [testing] add beit model
* [beit] fix bugs
* [beit] fix bugs
* [testing] fix bugs
|
2 years ago |
Jiarui Fang
|
5682e6d346
|
[hotfix] correcnt cpu_optim runtime compilation (#2197)
|
2 years ago |
oahzxl
|
1b8a066592
|
add chunk select class
|
2 years ago |
BlueRum
|
6642cebdbe
|
[example] Change some training settings for diffusion (#2195)
|
2 years ago |
HELSON
|
2458659919
|
[zero] fix error for BEiT models (#2169)
* [zero] fix error for BEiT models
* [ColoParameter] add unpack operation for tuple arguments
* fix bugs
* fix chunkv2 unit testing
* add assertion for gradient state
|
2 years ago |
ziyuhuang123
|
4363ff3e41
|
'[NFC] fix some typos' (#2175)
|
2 years ago |
binmakeswell
|
04a200573c
|
[NFC] update news link (#2191)
|
2 years ago |
Jiarui Fang
|
355ffb386e
|
[builder] unified cpu_optim fused_optim inferface (#2190)
|
2 years ago |
oahzxl
|
786a398a6b
|
code style
|
2 years ago |
oahzxl
|
9b1b890347
|
update run
|
2 years ago |
oahzxl
|
51ef8384c1
|
finish node reorder
|
2 years ago |
Jiarui Fang
|
9587b080ba
|
[builder] use runtime builder for fused_optim (#2189)
|
2 years ago |