github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
1,883 Commits
35 Branches
47 Tags
232 MiB
Commit Graph

1883 Commits (578374d0dec613d1d1f6595c01a925168c26d4fc)

Author SHA1 Message Date
Jiarui Fang 29868a9ec1
[example] update gpt readme with performance (#2206) 2022-12-27 17:39:53 +08:00
Jiarui Fang 1cb532ffec
[builder] multihead attn runtime building (#2203) 
* [hotfix] correcnt cpu_optim runtime compilation

* [builder] multihead attn

* fix bug

* fix a bug
 2022-12-27 16:06:09 +08:00
oahzxl cb2dd1a106 turn off print mem 2022-12-27 15:01:58 +08:00
oahzxl a2b4755ce9 code style 2022-12-27 14:49:52 +08:00
oahzxl 6be89a3b82 add chunksize in emit, fix bug in reassgin shape 2022-12-27 14:48:25 +08:00
Tongping Liu 8e22c38b89
[hotfix] Fixing the bug related to ipv6 support 
Co-authored-by: ByteDance <tongping.liu@bytedance.com>
 2022-12-27 12:42:46 +08:00
ziyuhuang123 ac85a18043
[example] polish doc (#2201) 2022-12-27 10:04:01 +08:00
oahzxl 378a49dc6c code style 2022-12-27 09:48:59 +08:00
oahzxl 8f5a0edfab add chunk select 2022-12-26 23:08:49 +08:00
YuliangLiu0306 4851f2d607
[autoparallel] update_getattr_handler (#2193) 2022-12-26 21:57:39 +08:00
YuliangLiu0306 f10ce01e31
[autoparallel] add gpt2 performance test code (#2194) 2022-12-26 21:56:58 +08:00
HELSON a3100bd50d
[testing] add beit model for unit testings (#2196) 
* [testing] add beit model

* [beit] fix bugs

* [beit] fix bugs

* [testing] fix bugs
 2022-12-26 17:35:36 +08:00
Jiarui Fang 5682e6d346
[hotfix] correcnt cpu_optim runtime compilation (#2197) 2022-12-26 16:45:14 +08:00
oahzxl 1b8a066592 add chunk select class 2022-12-26 15:28:01 +08:00
BlueRum 6642cebdbe
[example] Change some training settings for diffusion (#2195) 2022-12-26 15:22:20 +08:00
HELSON 2458659919
[zero] fix error for BEiT models (#2169) 
* [zero] fix error for BEiT models

* [ColoParameter] add unpack operation for tuple arguments

* fix bugs

* fix chunkv2 unit testing

* add assertion for gradient state
 2022-12-26 15:03:54 +08:00
ziyuhuang123 4363ff3e41
'[NFC] fix some typos' (#2175) 2022-12-25 18:41:39 +08:00
binmakeswell 04a200573c
[NFC] update news link (#2191) 2022-12-24 11:53:52 +08:00
Jiarui Fang 355ffb386e
[builder] unified cpu_optim fused_optim inferface (#2190) 2022-12-23 20:57:41 +08:00
oahzxl 786a398a6b code style 2022-12-23 17:42:51 +08:00
oahzxl 9b1b890347 update run 2022-12-23 17:32:11 +08:00
oahzxl 51ef8384c1 finish node reorder 2022-12-23 17:25:36 +08:00
Jiarui Fang 9587b080ba
[builder] use runtime builder for fused_optim (#2189) 2022-12-23 17:07:03 +08:00
oahzxl 884a228ea6 reorder nodes 2022-12-23 17:06:07 +08:00
Fazzie-Maqianli ce3c4eca7b
[example] support Dreamblooth (#2188) 2022-12-23 16:47:30 +08:00
BlueRum 1cf6d92d7c
[exmaple] diffuser, support quant inference for stable diffusion (#2186) 2022-12-23 16:06:29 +08:00
Jiarui Fang bc0e271e71
[buider] use builder() for cpu adam and fused optim in setup.py (#2187) 2022-12-23 16:05:13 +08:00
oahzxl e0ae68e736 code style 2022-12-23 15:49:04 +08:00
oahzxl fa5e6fbf96 code style 2022-12-23 15:38:37 +08:00
oahzxl 4f5e105af3 remove flow tracer 2022-12-23 15:34:41 +08:00
oahzxl 4d89525fc2 remove abandoned function 2022-12-23 14:28:49 +08:00
oahzxl 49ba619085 code style 2022-12-23 14:26:43 +08:00
oahzxl d309e9338b adapt codegen to prepose node 2022-12-23 14:26:12 +08:00
Jiarui Fang d42afd30f8
[builder] runtime adam and fused_optim builder (#2184) 2022-12-23 14:14:21 +08:00
oahzxl 522f017418 code style 2022-12-23 13:41:51 +08:00
oahzxl 774d34f1aa refactor flow search 2022-12-23 13:41:10 +08:00
YuliangLiu0306 550f8f8905
[autoparallel] integrate_gpt_related_tests (#2134) 
* [autoparallel] integrate_gpt_related_tests

* polish code

* polish code

* add GPT2Model into runtime test
 2022-12-23 12:36:59 +08:00
Ziyue Jiang 59e343328d
[Pipeline Middleware ] Fix deadlock when num_microbatch=num_stage (#2156) 
* add splitter

* polish code

* remove comment

* fix async nan by moving to cpu first

Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>
 2022-12-23 11:38:43 +08:00
github-actions[bot] 937f404253
Automated submodule synchronization (#2136) 
Co-authored-by: github-actions <github-actions@github.com>
 2022-12-23 09:34:48 +08:00
Jiarui Fang 65f56f49e8
[example] gpt demo more accuracy tflops (#2178) 2022-12-22 20:51:35 +08:00
Tongping Liu ab54fed292
[hotfix] add kwargs for colo_addmm (#2171) 2022-12-22 13:25:30 +08:00
Arsmart1 a110933d65
[NFC] fix a typo 'stable-diffusion-typo-fine-tune' 
Co-authored-by: ziyuhuang123 <202476410@qq.com>
 2022-12-22 10:57:05 +08:00
Fazzie-Maqianli 9396a18361
Merge pull request #2174 from ziyuhuang123/main 
'diffusion-typo-change'
 2022-12-22 10:37:55 +08:00
ziyuhuang123 cf5028363c 'diffusion-typo-change' 2022-12-22 10:28:59 +08:00
アマデウス 622f863291
[hotfix] Jit type hint #2161 (#2164) 2022-12-22 10:17:03 +08:00
Jiarui Fang 27327a4c90
[example] add palm pytorch version (#2172) 2022-12-22 10:15:34 +08:00
Zihao 12e7bcd720
register meta func for rnn (#2159) 2022-12-21 23:06:18 +08:00
oahzxl ded1005667 format code 2022-12-21 15:03:08 +08:00
oahzxl d361d533e8 refactor flow tracer 2022-12-21 15:01:03 +08:00
oahzxl d734529a39 move flow tracer 2022-12-21 15:00:24 +08:00