Jiarui Fang
|
db4cbdc7fb
|
[builder] builder for scaled_upper_triang_masked_softmax (#2234)
|
2022-12-30 09:58:00 +08:00 |
|
HELSON
|
31fe84237b
|
[example] fix benchmark.sh for gpt example (#2229)
|
2022-12-29 23:00:14 +08:00 |
|
Super Daniel
|
78483a9fdd
|
[logger] hotfix, missing _FORMAT (#2231)
|
2022-12-29 22:59:39 +08:00 |
|
Jiarui Fang
|
2cdecc9f38
|
[example] make palm + GeminiDPP work (#2227)
|
2022-12-29 14:28:31 +08:00 |
|
ZijianYY
|
63cc77173b
|
[example] Palm adding gemini, still has bugs (#2221)
|
2022-12-29 14:01:09 +08:00 |
|
HELSON
|
7010e18134
|
[example] update gpt example (#2225)
|
2022-12-29 12:01:45 +08:00 |
|
Jiarui Fang
|
49c601da21
|
[example] add benchmark.sh for gpt (#2226)
|
2022-12-29 12:00:00 +08:00 |
|
HELSON
|
3629e611cd
|
[example] update gpt benchmark (#2219)
|
2022-12-29 10:51:42 +08:00 |
|
Jiarui Fang
|
54de05da5d
|
[builder] polish builder with better base class (#2216)
* [builder] polish builder
* remove print
|
2022-12-28 19:45:49 +08:00 |
|
YuliangLiu0306
|
3b1b91eaf4
|
[autoparallel] record parameter attribute in colotracer (#2217)
* [autoparallel] record parameter attribute in collotracer
* [autoparallel] fix construct_meta_info bug
|
2022-12-28 19:29:08 +08:00 |
|
ZijianYY
|
92de90dfb3
|
[examples] replace einsum with matmul (#2210)
|
2022-12-28 19:03:06 +08:00 |
|
Jiarui Fang
|
7675792100
|
[builder] raise Error when CUDA_HOME is not set (#2213)
|
2022-12-28 16:07:08 +08:00 |
|
HELSON
|
78a89d9b41
|
[diffusion] update readme (#2214)
|
2022-12-28 16:06:48 +08:00 |
|
Jiarui Fang
|
d96cc37e32
|
[example] update GPT example benchmark results (#2212)
|
2022-12-28 14:28:12 +08:00 |
|
Jiarui Fang
|
d5e3e3ec01
|
[example] update gpt example for larger model scale (#2211)
|
2022-12-28 13:54:08 +08:00 |
|
Boyuan Yao
|
24246f7aa5
|
[autoparallel] Attach input, buffer and output tensor to MetaInfo class (#2162)
* [fx] metainfo class for auto parallel
* [fx] add unit test for linear metainfo
* [fx] fix bwd param for linear
* [fx] modify unit test
* [fx] modify unit test
* [fx] modify import
* [fx] modify import
* [fx] modify import
* [fx] move meta profiler to auto parallel
* [fx] add conv metainfo class
* [fx] restore profiler
* [fx] restore meta profiler
* [autoparallel] modify unit test
* [fx] modify unit test
* [autoparallel] add batchnorm metainfo class
* [autoparallel] fix batchnorm unit test function declaration
* [fx] restore profiler
* [fx] add relu metainfo class
* [fx] restore profiler
* [autoparallel] modify metainfo input
* [autoparallel] add pooling metainfo
* [autoparallel] add F.linear metainfo generator
* [autoparallel] add binary elementwise metainfo
* [fx] recover profiler
* [autoparallel] fix forward memory calculation
* [autoparallel] modify constants.py
* [autoparallel] remove redundant print
* [autoparallel] add F.conv metainfo
* [autoparallel] linear fix
* [autoparallel] memory estimation for communication actions
* [autoparallel] fix docstring
* [autoparallel] fix variables name
* [autoparallel] attach tensor to metainfo class
* [autoparallel] fix dangerous try except
* [autoparallel] attach memory cost to shape consistency node
* [autoparallel] attach shape consistency node's metainfo to the node
* [autoparallel] remove todo in shape consistency memory estimation
* [autoparallel] fix the annotation
|
2022-12-28 13:37:40 +08:00 |
|
Boyuan Yao
|
d0bc5a1b34
|
[autoparallel] new metainfoprop based on metainfo class (#2179)
* [autoparallel] new metainfoprop to combine SPMD solver and checkpoint solver
* [autoparallel] new metainfoprop to combine SPMD solver and checkpoint solver
* [autoparallel] modify placeholder handler
* [autoparallel] modify metainfoprop
* [autoparallel] fix function typo
* [autoparallel] fix placeholder handler
|
2022-12-28 13:35:08 +08:00 |
|
YuliangLiu0306
|
78509124d3
|
[autoparallel] update getitem handler (#2207)
|
2022-12-27 19:58:32 +08:00 |
|
Jiarui Fang
|
29868a9ec1
|
[example] update gpt readme with performance (#2206)
|
2022-12-27 17:39:53 +08:00 |
|
Jiarui Fang
|
1cb532ffec
|
[builder] multihead attn runtime building (#2203)
* [hotfix] correcnt cpu_optim runtime compilation
* [builder] multihead attn
* fix bug
* fix a bug
|
2022-12-27 16:06:09 +08:00 |
|
Tongping Liu
|
8e22c38b89
|
[hotfix] Fixing the bug related to ipv6 support
Co-authored-by: ByteDance <tongping.liu@bytedance.com>
|
2022-12-27 12:42:46 +08:00 |
|
ziyuhuang123
|
ac85a18043
|
[example] polish doc (#2201)
|
2022-12-27 10:04:01 +08:00 |
|
YuliangLiu0306
|
4851f2d607
|
[autoparallel] update_getattr_handler (#2193)
|
2022-12-26 21:57:39 +08:00 |
|
YuliangLiu0306
|
f10ce01e31
|
[autoparallel] add gpt2 performance test code (#2194)
|
2022-12-26 21:56:58 +08:00 |
|
HELSON
|
a3100bd50d
|
[testing] add beit model for unit testings (#2196)
* [testing] add beit model
* [beit] fix bugs
* [beit] fix bugs
* [testing] fix bugs
|
2022-12-26 17:35:36 +08:00 |
|
Jiarui Fang
|
5682e6d346
|
[hotfix] correcnt cpu_optim runtime compilation (#2197)
|
2022-12-26 16:45:14 +08:00 |
|
BlueRum
|
6642cebdbe
|
[example] Change some training settings for diffusion (#2195)
|
2022-12-26 15:22:20 +08:00 |
|
HELSON
|
2458659919
|
[zero] fix error for BEiT models (#2169)
* [zero] fix error for BEiT models
* [ColoParameter] add unpack operation for tuple arguments
* fix bugs
* fix chunkv2 unit testing
* add assertion for gradient state
|
2022-12-26 15:03:54 +08:00 |
|
ziyuhuang123
|
4363ff3e41
|
'[NFC] fix some typos' (#2175)
|
2022-12-25 18:41:39 +08:00 |
|
binmakeswell
|
04a200573c
|
[NFC] update news link (#2191)
|
2022-12-24 11:53:52 +08:00 |
|
Jiarui Fang
|
355ffb386e
|
[builder] unified cpu_optim fused_optim inferface (#2190)
|
2022-12-23 20:57:41 +08:00 |
|
Jiarui Fang
|
9587b080ba
|
[builder] use runtime builder for fused_optim (#2189)
|
2022-12-23 17:07:03 +08:00 |
|
Fazzie-Maqianli
|
ce3c4eca7b
|
[example] support Dreamblooth (#2188)
|
2022-12-23 16:47:30 +08:00 |
|
BlueRum
|
1cf6d92d7c
|
[exmaple] diffuser, support quant inference for stable diffusion (#2186)
|
2022-12-23 16:06:29 +08:00 |
|
Jiarui Fang
|
bc0e271e71
|
[buider] use builder() for cpu adam and fused optim in setup.py (#2187)
|
2022-12-23 16:05:13 +08:00 |
|
Jiarui Fang
|
d42afd30f8
|
[builder] runtime adam and fused_optim builder (#2184)
|
2022-12-23 14:14:21 +08:00 |
|
YuliangLiu0306
|
550f8f8905
|
[autoparallel] integrate_gpt_related_tests (#2134)
* [autoparallel] integrate_gpt_related_tests
* polish code
* polish code
* add GPT2Model into runtime test
|
2022-12-23 12:36:59 +08:00 |
|
Ziyue Jiang
|
59e343328d
|
[Pipeline Middleware ] Fix deadlock when num_microbatch=num_stage (#2156)
* add splitter
* polish code
* remove comment
* fix async nan by moving to cpu first
Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>
|
2022-12-23 11:38:43 +08:00 |
|
github-actions[bot]
|
937f404253
|
Automated submodule synchronization (#2136)
Co-authored-by: github-actions <github-actions@github.com>
|
2022-12-23 09:34:48 +08:00 |
|
Jiarui Fang
|
65f56f49e8
|
[example] gpt demo more accuracy tflops (#2178)
|
2022-12-22 20:51:35 +08:00 |
|
Tongping Liu
|
ab54fed292
|
[hotfix] add kwargs for colo_addmm (#2171)
|
2022-12-22 13:25:30 +08:00 |
|
Arsmart1
|
a110933d65
|
[NFC] fix a typo 'stable-diffusion-typo-fine-tune'
Co-authored-by: ziyuhuang123 <202476410@qq.com>
|
2022-12-22 10:57:05 +08:00 |
|
Fazzie-Maqianli
|
9396a18361
|
Merge pull request #2174 from ziyuhuang123/main
'diffusion-typo-change'
|
2022-12-22 10:37:55 +08:00 |
|
ziyuhuang123
|
cf5028363c
|
'diffusion-typo-change'
|
2022-12-22 10:28:59 +08:00 |
|
アマデウス
|
622f863291
|
[hotfix] Jit type hint #2161 (#2164)
|
2022-12-22 10:17:03 +08:00 |
|
Jiarui Fang
|
27327a4c90
|
[example] add palm pytorch version (#2172)
|
2022-12-22 10:15:34 +08:00 |
|
Zihao
|
12e7bcd720
|
register meta func for rnn (#2159)
|
2022-12-21 23:06:18 +08:00 |
|
Boyuan Yao
|
cfe2a9bd90
|
[autoparallel] memory estimation for shape consistency (#2144)
* [fx] metainfo class for auto parallel
* [fx] add unit test for linear metainfo
* [fx] fix bwd param for linear
* [fx] modify unit test
* [fx] modify unit test
* [fx] modify import
* [fx] modify import
* [fx] modify import
* [fx] move meta profiler to auto parallel
* [fx] add conv metainfo class
* [fx] restore profiler
* [fx] restore meta profiler
* [autoparallel] modify unit test
* [fx] modify unit test
* [autoparallel] add batchnorm metainfo class
* [autoparallel] fix batchnorm unit test function declaration
* [fx] restore profiler
* [fx] add relu metainfo class
* [fx] restore profiler
* [autoparallel] modify metainfo input
* [autoparallel] add pooling metainfo
* [autoparallel] add F.linear metainfo generator
* [autoparallel] add binary elementwise metainfo
* [fx] recover profiler
* [autoparallel] fix forward memory calculation
* [autoparallel] modify constants.py
* [autoparallel] remove redundant print
* [autoparallel] add F.conv metainfo
* [autoparallel] linear fix
* [autoparallel] memory estimation for communication actions
* [autoparallel] fix docstring
* [autoparallel] fix variables name
|
2022-12-21 10:39:37 +08:00 |
|
Jiarui Fang
|
b87496a66b
|
[hotfix] fix auto policy of test_sharded_optim_v2 (#2157)
|
2022-12-20 23:03:18 +08:00 |
|
YuliangLiu0306
|
16335cb537
|
[hotfix] fix aten default bug (#2158)
|
2022-12-20 22:40:46 +08:00 |